Skip to content

Shmh40/dev ssl/safe delivrbl tjepa model real time frcst - #2788

Draft
shmh40 wants to merge 126 commits into
preop_082026from
shmh40/dev-ssl/safe-delivrbl-tjepa-model-real-time-frcst
Draft

Shmh40/dev ssl/safe delivrbl tjepa model real time frcst#2788
shmh40 wants to merge 126 commits into
preop_082026from
shmh40/dev-ssl/safe-delivrbl-tjepa-model-real-time-frcst

Conversation

@shmh40

@shmh40 shmh40 commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Description

Issue Number

Is this PR a draft? Mark it as draft.

Checklist before asking for review

  • I have performed a self-review of my code
  • My changes comply with basic sanity checks:
    • I have fixed formatting issues with ./scripts/actions.sh lint
    • I have run unit tests with ./scripts/actions.sh unit-test
    • I have documented my code and I have updated the docstrings.
    • I have added unit tests, if relevant
  • I have tried my changes with data and code:
    • I have run the integration tests with ./scripts/actions.sh integration-test
    • (bigger changes) I have run a full training and I have written in the comment the run_id(s): launch-slurm.py --time 60
    • (bigger changes and experiments) I have shared a hegdedoc in the github issue with all the configurations and runs for this experiments
  • I have informed and aligned with people impacted by my change:
    • for config changes: the MatterMost channels and/or a design doc
    • for changes of dependencies: the MatterMost software development channel

FastEvaluation

  • I have updated the public documentation if necessary

Sophie Xhonneux and others added 30 commits February 18, 2026 19:11
Sophie Xhonneux Sophie Xhonneux
Write first solution with Claude
d6d51da
@sophie-xhonneux
Add test configs, works on santis
a6e4c25
@clessig
Merge branch 'develop' of github.com:ecmwf/WeatherGenerator into soph…
e65241a 
…iex/dev/warm-and-frozen-teachers
@clessig
Merge branch 'develop' into sophiex/dev/warm-and-frozen-teachers
66de4c0
@clessig
Merge branch 'develop' of github.com:ecmwf/WeatherGenerator into soph…
9fbe081 
…iex/dev/warm-and-frozen-teachers
@clessig
Disabling rope; removing model config from finetuning since it needs …
af9a02c 
…to be (at least here) identical
@sophie-xhonneux
Merge branch 'develop' into sophiex/dev/warm-and-frozen-teachers
da23d8a
@sophie-xhonneux
Add new JEPA config
1ccad2b
@sophie-xhonneux
Commit experiment
019357a
Sophie Xhonneux Sophie Xhonneux
Add alternative Local2Global + fix grad norm comp
d6d1ebb
@sophie-xhonneux
Update configs and plotting configs
90213f8
@sophie-xhonneux
Merge branch 'sophiex/dev/exp-week8-frozen-sweep-mask-lr' into sophie…
d11ca16 
…x/dev/exp-week9-local2global
@sophie-xhonneux
Test new engine
81c847b
@sophie-xhonneux
Try RMSNorm for the QK norm, important caveat this has a learnable pa…
a5c973f 
…rameter for us
@sophie-xhonneux
Add missing changes
7b4987d
@sophie-xhonneux
Add configs
85b8d68
@sophie-xhonneux
Try long runs
e35a92d
@sophie-xhonneux
Save new experiment
cb31a61
@sophie-xhonneux
Merge branch 'develop' into develop-ssl
d79df4a
@sophie-xhonneux
New default config jepa
6745a24
@sophie-xhonneux
Merge branch 'develop' into develop-ssl
3c6ee31
@sophie-xhonneux
Implement JEPA v2.1 improvements
668ff66
@sophie-xhonneux
Merge branch 'develop' into sophiex/dev-ssl/deep-ssl
d4eb9bc
@sophie-xhonneux
Update the configs
ffc85e3
@sophie-xhonneux
Add pipeline to record first test
b325950
@shmh40
Merge remote-tracking branch 'origin/develop' into develop-ssl
370887b
@sophie-xhonneux
Save state of initial V JEPA 2.1 runs
1bb0a09 
We identified a bug whereby  context loss is only computed on the last
layer. This will be fixed in the next commits, but we need to save the
current state for reproducibility.
@sophie-xhonneux
Fix error of context loss only applied on final year + cleanup
cb0af9a
@sophie-xhonneux
Test new student arch
179792a
@sophie-xhonneux
Jobs don't finish in 12 hours on Jupiter
d712ca8
shmh40 and others added 25 commits June 6, 2026 19:10
@shmh40
configs for forecast finetuning
2b90f4e
@shmh40
config frcst all years
f9a16e2
@shmh40
op multi data forecast
0745006
@shmh40
increase num_workers od ft
b9354f6
@shmh40
configs with correct training
af9c563
@shmh40
configs with correct training and istep 0
a0f4675
@shmh40
configs with no freezing
b2143a7
@shmh40
increase num workers
efa783a
@shmh40
16 fe blocks
bab2a5b
@shmh40
16 fe blocks
d74576d
@shmh40
correct the type of ERA5_in so that we use the nominal time mapping c…
edba868 
…orrectly
@shmh40
add the era5 frequency of 1st stage forecasting to be 010000, before …
daee7db 
…it was 060000
@shmh40
2fstep_6h tws configs
c69c0a4
@shmh40
jepa configs 2step 6h tws
29e3247
@shmh40
configs with correct synop dataset
8dff376
@shmh40
change frequency of era5 output to be 6h
b73cbc0
@shmh40
grad clip back to 1.0
2b2e8cf
@shmh40
increase synop token size
5528b83
@shmh40
ae local max tokens per cell and synop return
2e7984d
@shmh40
minor patch to msds for temporal jepa
9719968
@shmh40
streams configs for temporal jepa
2724e62
@shmh40
all latest stream configs and for temporal jepa
5374527
@shmh40
up to date configs
e27a8d2
@shmh40
operational analysis configs
ceb88e8
@shmh40
changes needed to run chkpt af90zz71 in real-time forecast mode. offg…
28bcb55 
…rid data reader, parsing frequency and allow future end date in data_reader_anemoi, check latest analysis in operan reader, msds allow offgrid reader, example cstream configs
@github-actions github-actions Bot added data Anything related to the datasets used in the project eval anything related to the model evaluation pipeline infra Issues related to infrastructure model Related to model training or definition (not generic infra) labels Aug 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

data Anything related to the datasets used in the project eval anything related to the model evaluation pipeline infra Issues related to infrastructure model Related to model training or definition (not generic infra)

Projects

WeatherGen-dev
Status: No status

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@shmh40 @sophie-xhonneux @clessig @MatKbauer