Skip to content

test(promql-compliance): add olly-bench suite and p75 quantile queries #739

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
milindsrivastava1997 merged 1 commit into from
Sep 23, 2026
Merged

test(promql-compliance): add olly-bench suite and p75 quantile queries #739

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/promql-differential.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ jobs:

- name: Run live PromQL differential suite
working-directory: promql-compliance/runner
run: make run-all
run: make run-for-ci

- name: Upload differential report and service logs
if: always()
Expand Down
16 changes: 12 additions & 4 deletions promql-compliance/HOW_TO.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,16 +91,24 @@ make run \
SUITE=../suites/aggregations.yaml
```

The PromQL differential CI workflow runs the checked-in pairs listed in the
runner Makefile's `CASES` variable. Adding a YAML file does not automatically
add it to CI; add a case there when adding a new dataset/suite pair.
The PromQL differential CI workflow runs `make run-for-ci`, which covers the
pairs in the runner Makefile's `CI_CASES` variable. Pairs that are expected to
fail, such as `olly-bench` (planner coverage tracking), go in `NON_CI_CASES`.
Adding a YAML file does not automatically add it to either list; add a case
there when adding a new dataset/suite pair.

To run all checked-in pairs locally and write one report per pair:
To run every checked-in pair locally and write one report per pair:

```bash
make run-all
```

To run only the CI pairs:

```bash
make run-for-ci
```

Reports are written to `/tmp/asapquery-differential-reports` by default. Set
`REPORT_DIR` to choose another output directory.

Expand Down
Loading
Loading