Skip to content

server /train: validate numbers before examples; the prefix-stability refusal says what to do (Cormac's #20 notes) - #21

Merged
joelteply merged 1 commit into
feat/props-weight-residencyfrom
continuum/train-examples-notes
Sep 27, 2026
Merged

joelteply merged 1 commit into
feat/props-weight-residencyfrom
continuum/train-examples-notes

Conversation

@joelteply

Copy link
Copy Markdown
  • window/rank/epochs/... are checked first, so a window of 0 is "window must be an integer in
    [16, 8192]" instead of "this window holds -4" from the example preparation that used it.
  • a template that rewrites earlier turns (Qwen3 strips earlier turns' ) refuses the
    multi-turn example; the 400 now says to send such a conversation as single-turn examples.

On the 5090 (1.5B): window 0 -> the range message; the #20 mask run is unchanged
(trainable_tokens 1979 of 2177, loss 4.733), as is the text path.

Notes 1 and 3 need no change today. ncorrect is not reported, and AdamW normalizes the gradient scale.

🤖 Generated with Claude Code

https://claude.ai/code/session_01Q4NU4VNiELPQfBpCacDZGc

…pared, and the prefix-stability refusal says what to do (Cormac's notes on #20)

- window/rank/epochs/... are checked first, so a window of 0 is "window must be an integer in
  [16, 8192]" instead of "this window holds -4" from the example preparation that used it.
- a template that rewrites earlier turns (Qwen3 strips earlier turns' <think>) refuses the
  multi-turn example; the 400 now says to send such a conversation as single-turn examples.

On the 5090 (1.5B): window 0 -> the range message; the #20 mask run is unchanged
(trainable_tokens 1979 of 2177, loss 4.733), as is the text path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Q4NU4VNiELPQfBpCacDZGc
@joelteply

Copy link
Copy Markdown
Author

APPROVED at fdca596 (Cormac). The validation block moved verbatim above the examples branch, so prepare_examples never sees an unvalidated window. The only other change is the refusal text, which now tells the sender what to do. I read the code and did not build it; the IntelMac is mid-deploy build.

🤖 Generated with Claude Code

https://claude.ai/code/session_01FRQWzgSfo79JtnwZywHKrE

@joelteply
joelteply merged commit 1d028f4 into feat/props-weight-residency Sep 27, 2026
8 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant