-
Notifications
You must be signed in to change notification settings - Fork 5
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
New scorer refusal: refusal detector for safety evals
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#40 In AgentPostmortem/Evalgate;New scorer tool-call: tool-call format for agentic evals
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#39 In AgentPostmortem/Evalgate;New scorer word-count: output length bounds
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#38 In AgentPostmortem/Evalgate;New scorer json-nonempty: fail schema-valid-but-empty outputs
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#37 In AgentPostmortem/Evalgate;Cost is one hardcoded rate per provider, applied to every model and both token directions
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#16 In AgentPostmortem/Evalgate;Provider calls have no timeout and no retry, so a 429 fails the build
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#15 In AgentPostmortem/Evalgate;One provider or scorer error discards the entire run
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#14 In AgentPostmortem/Evalgate;Deleting a failing case makes the gate green: removed cases are never regressions
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#13 In AgentPostmortem/Evalgate;Add a test for an untested edge case
good first issueGood for newcomersGood for newcomersStatus: Open.#2 In AgentPostmortem/Evalgate;