Repository navigation
server /train: validate numbers before examples; the prefix-stability refusal says what to do (Cormac's #20 notes) - #21
Merged
joelteply merged 1 commit intoSep 27, 2026
Conversation
…pared, and the prefix-stability refusal says what to do (Cormac's notes on #20) - window/rank/epochs/... are checked first, so a window of 0 is "window must be an integer in [16, 8192]" instead of "this window holds -4" from the example preparation that used it. - a template that rewrites earlier turns (Qwen3 strips earlier turns' <think>) refuses the multi-turn example; the 400 now says to send such a conversation as single-turn examples. On the 5090 (1.5B): window 0 -> the range message; the #20 mask run is unchanged (trainable_tokens 1979 of 2177, loss 4.733), as is the text path. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Q4NU4VNiELPQfBpCacDZGc
Author
|
APPROVED at fdca596 (Cormac). The validation block moved verbatim above the examples branch, so 🤖 Generated with Claude Code |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
[16, 8192]" instead of "this window holds -4" from the example preparation that used it.
multi-turn example; the 400 now says to send such a conversation as single-turn examples.
On the 5090 (1.5B): window 0 -> the range message; the #20 mask run is unchanged
(trainable_tokens 1979 of 2177, loss 4.733), as is the text path.
Notes 1 and 3 need no change today. ncorrect is not reported, and AdamW normalizes the gradient scale.
🤖 Generated with Claude Code
https://claude.ai/code/session_01Q4NU4VNiELPQfBpCacDZGc