Skip to content

Publish passing benchmark results - #6

Merged
plajjan merged 6 commits into
mainfrom
runner-compat
Sep 22, 2026
Merged

plajjan merged 6 commits into
mainfrom
runner-compat

Conversation

@plajjan

@plajjan plajjan commented Sep 22, 2026 •

Copy link
Copy Markdown

A failed language currently blocks every result from reaching Pages. Publish the languages that pass and list missing languages on the site.

Fix container image lookup, C and C# CPU assumptions, and the TypeScript sieve stack overflow on the dedicated runner.

Kristian Larsson added 4 commits September 22, 2026 22:37
The native vector width can be two doubles, which drops the z
coordinate in nbody and breaks Mandelbrot lane access. Use fixed
256-bit vectors so both programs retain all four lanes.
Calling upstream generators exhausts the stack at large inputs.
Yield before each request so the coroutine chain resumes without
recursing through every stage on the same call stack.
@plajjan plajjan changed the title Fix benchmark runner compatibility Publish passing benchmark results Sep 22, 2026
@plajjan
plajjan marked this pull request as ready for review September 22, 2026 21:06
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 22, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-22T21:10:29.093995Z e8491da Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

One failed language blocks every result from reaching Pages. Publish
verified languages and show which ones are missing.

Keep failed jobs visible and reject empty or mixed-run results.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e8491daacd

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .github/suite.py

def collect_results():
results = BENCH / 'build/_results'
available = sorted(p.name for p in results.iterdir() if p.is_dir()) if results.exists() else []

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Reject artifacts left by earlier workflow attempts

When all jobs are re-run, artifacts from earlier attempts remain under the same workflow run, and a language overwrites its artifact only if it reaches the upload step. Because available accepts every downloaded result directory while verification checks the SHA and run ID but not the githubRunAttempt recorded in bench/tool/Program.cs:776, a language that fails before uploading in the current attempt can be silently published using measurements from a prior attempt. Namespace or filter artifacts by attempt, or otherwise verify that each selected artifact belongs to an acceptable attempt before deriving available.

Useful? React with 👍 / 👎.

GCC can use AVX-512 fused arithmetic even with -mno-fma. Disable
expression contraction to keep the expected Mandelbrot output on
these CPUs.
@plajjan
plajjan merged commit 4115d3d into main Sep 22, 2026
9 of 42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant