Skip to content

[telemetry_chargeback] FVT - Add rate query and validation - #417

Draft
ayefimov-1 wants to merge 5 commits into
masterfrom
alexy_ck_job_8l
Draft

[telemetry_chargeback] FVT - Add rate query and validation #417
ayefimov-1 wants to merge 5 commits into
masterfrom
alexy_ck_job_8l

Conversation

@ayefimov-1

@ayefimov-1 ayefimov-1 commented Jul 15, 2026

Copy link
Copy Markdown
Contributor
  • Retrieves CloudKitty rating totals from Loki
  • Compares synthetic test data against actual Loki results
  • Provides automated pass/fail assertions
  • Ensures end-to-end data integrity

Authored-by: @ayefimov-1
AI Assisted by: Claude

Depends-On: #420

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/2507d374a833428a87ce4e07c4039c57

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 40m 48s
functional-chargeback-tests-osp18 FAILURE in 2h 14m 24s
✔️ functional-tests-osp18 SUCCESS in 2h 18m 09s

@ayefimov-1
ayefimov-1 marked this pull request as draft July 15, 2026 15:54
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/a3d6ff4937704d989e53419f9c62cefe

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 40m 43s
functional-chargeback-tests-osp18 FAILURE in 1h 55m 19s
✔️ functional-tests-osp18 SUCCESS in 2h 17m 17s

@ayefimov-1

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,a2b9bf97ece05f6d34c0aa94f5d7c0b93e2256f8

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,393c7c5801c7abf235a14bbed6ca1b3eea6eaedc

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/953de3e01022490aaba28b374a062872

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 36m 14s
✔️ functional-chargeback-tests-osp18 SUCCESS in 2h 10m 46s
functional-tests-osp18 RETRY_LIMIT in 7m 50s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/921d56d9562848d69bb9641d6f41489f

telemetry-openstack-meta-content-provider-master FAILURE in 23m 45s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

@ayefimov-1

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/a57850c033364b72b637cb4f40b29415

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 32m 05s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 44m 04s
functional-tests-osp18 FAILURE in 2h 07m 57s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/3f48926f0dd240fab7ca26ffb1de5472

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 31m 26s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 38m 17s
functional-tests-osp18 FAILURE in 2h 06m 26s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,55f9621fad99267a7c7ec94c66b6547fe3e8983d

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,4cbaeeec2994c58c41ccc28faa0313f928f20a63

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/559bd4d899eb474db70e61167da76891

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 23m 38s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 48m 55s
functional-tests-osp18 NODE_FAILURE Node(set) request 099-0000154748 failed in 0s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,9a5aa0157ebb0a82a0c9b98143138ba655e878b0

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/6e7ef91d87dd41b89d7ab174c0d6f216

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 39m 57s
functional-chargeback-tests-osp18 NODE_FAILURE Node(set) request 099-0000154898 failed in 0s
functional-tests-osp18 NODE_FAILURE Node(set) request 099-0000154899 failed in 0s

…itty testing

- Compute price at generation time: price = unit_cost * qty_mutated
- Simplify gen_db_summary.py to sum price directly (matching CK method)
- Add _apply_mutate() for NUMBOOL/CEIL/FLOOR transforms
- Rename timestamp variables for consistency across role
- Add job_scenario_stats.yml for per-scenario rate accumulation
- Add loki_total_rate.yml with Loki monthly query, CK rating/dataframes
- Assert synthetic rating matches CK rating within 0.5% tolerance
- Update test scenarios: 1-hour window, 300s steps, realistic costs
- Remove factor/offset and redundant debug tasks

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/2eda273d54904c4c830666b2f75bbdc4

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 28m 14s
functional-chargeback-tests-osp18 RETRY_LIMIT in 3m 42s
functional-tests-osp18 RETRY_LIMIT in 3m 49s

@ayefimov-1

Copy link
Copy Markdown
Contributor Author

recheck

Rename artifacts_dir to ck_artifacts_dir and remove redundant
artifacts_dir_zuul alias and unused logs_dir_zuul variable.
Update README.md to reflect current role state.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/3e019a202d5643da8289b327ed0f09aa

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 45m 44s
functional-chargeback-tests-osp18 POST_FAILURE in 24m 27s
✔️ feature-verification-tests-noop SUCCESS in 1m 06s
✔️ functional-tests-osp18 SUCCESS in 2h 22m 08s

@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,e13fe7b3c7d43238412a251cd5d4649e871419a3

…fixes

Add Loki ring convergence check to setup description, fix end_time
default to show 2-hour offset, add mutate/factor/offset to
gen_db_summary description, fix typo.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@centosinfra-prod-github-app

Copy link
Copy Markdown

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/feature-verification-tests for 417,dd0b0cb10daf7fe66e0de8c60a6d0e97cbf5e3bd

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/0f00d13b1693412bb13561872d75a8fe

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 46m 04s
functional-chargeback-tests-osp18 FAILURE in 1h 33m 01s
✔️ functional-tests-osp18 SUCCESS in 2h 22m 03s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant