修复浏览器评测证据的实现后绑定与离线复验 - #89
Merged
Merged
Conversation
Owner
Author
独立验收 PASS(更新后的主干基准)精确 head 037427e / base 18dbe32。新上下文验收者亲自通过 Chrome/Playwright 输入 Ada、点击 Save、观察 Saved Ada,检查 screenshot 与 trace 的 goto/fill/click/innerText,记录导入后 PASS。独立 CLI 16 个场景(15 个拒绝、1 个移除临时fixture后的离线 PASS)验证绑定/过期/错条件/代码及产物变更。完整 215/215 测试与本地所有 CI 命令、远端精确 head Thinloop CI PASS。 |
This was referenced Sep 5, 2026
Closed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refs #84
页面评测过去在 Agent 实施前要求浏览器证据,同时离线重评分直接信任保存的
ok,不存在的截图路径也可能通过。现在先运行实现并记录代码快照,再用rescore.mjs --browser-evidence导入真实浏览器记录;缺少证据时保留 BLOCKED。导入和离线重评分验证 schema v2、runId、case、condition、实现快照、采集时间及产物实际 SHA-256。导入要求原 fixture 未变更,有效记录和文件冻结到运行目录;离线重评分每次重新校验字节与绑定,fixture 仍存在时额外检查当前代码未改变。文档提供完整两步命令与 JSON 格式。
验证:
node --test tests/*.test.mjs:200/200 通过;覆盖旧格式、错运行/条件、过期证据、缺失/篡改文件、实现变化、离线冻结重评分及不能绕过保存的 ok。/tmp/thinloop84-live-WxXxPe;截图capture/save.png,tracecapture/trace.zip,原始记录capture/evidence.json,冻结记录browser-evidence/browser-form-acceptance--native/evidence.json,评分rescore.json。浏览器和静态服务已关闭。边界:哈希验证绑定与完整性,不能单独证明外部填写的动作声明真实。未运行新的模型三臂 benchmark,不声明整体收益。此变更不涉及安装载荷,因此无需刷新本地 Agent。
独立验收、合并版本及父 Execute 资源清理待完成,Issue 保持开放。