Persist PSF products and add the two campaign-level merges (exp_persist, star_cat_merge, final_cat_merge) - #879

Open

cailmdaley wants to merge 22 commits into

feat/persist-exp-products

Commits on Sep 9, 2026

feat(orchestration): the keep list, and the script that acts on it

authored and
cailmdaley
committed
681f156
feat(orchestration): exp_persist, between exp_psf and clean_exposure

authored and
cailmdaley
committed
de243a8
docs(orchestration): exp_persist in the rule list, and why the report omits it

authored and
cailmdaley
committed
4cf639f
feat(orchestration): exp_persist packs one tar per exposure, not loose copies

cailmdaley
and
claude
committed
1fa6455
fix(orchestration): persist_exp never leaves a .tmp behind on failure

cailmdaley
and
claude
committed
a14a2f3
docs(orchestration): drop references to the removed star-catalogue rules

cailmdaley
and
claude
committed
d91da36
feat(orchestration): the two campaign-level merges

cailmdaley
and
claude
committed
626aaba
fix(orchestration): seven defects in the campaign-level merges

cailmdaley
and
claude
committed
fc9aa3e
fix(create_final_cat): make the merged-catalogue writer reproducible

cailmdaley
and
claude
committed
d774cc3
perf(orchestration): size the two merges from the data, not from a guess

cailmdaley
and
claude
committed
98532ce
feat(orchestration): persist_exp keeps NAMED products, not globs

cailmdaley
and
claude
committed
d0ecfdd
perf(merge_starcat): accumulate arrays, not python lists of floats

cailmdaley
and
claude
committed
3b8c7d5
feat(orchestration): the star catalogue's inputs are not a user choice

cailmdaley
and
claude
committed
0ad6403
fix(cfis): two stale columns in final_cat.param, and no mask column at all

cailmdaley
and
claude
committed
90dfb00
perf(merge_starcat): two passes, so nothing is held twice

cailmdaley
and
claude
committed
a434c9a
feat(orchestration): final_cat_merge reconciles instead of rebuilding

cailmdaley
and
claude
committed
3c29825

Commits on Sep 10, 2026

fix(orchestration): eight defects found reviewing the merge work

cailmdaley
and
claude
committed
78d2ce9
feat(orchestration): the star catalogue becomes hdf5, reconciled like the tile one

cailmdaley
and
claude
committed
0fb514b
fix(orchestration): nine findings from the third review

cailmdaley
and
claude
committed
4ed9fb0
test(unit): property-based state machines for reconcile and persist_exp

cailmdaley
and
claude
committed
e86d8c8
fix(persist-exp): the PSF run dir is run_sp_exp_SxSePsf

cailmdaley
and
claude
committed
1a343e6

Commits on Sep 17, 2026

final_cat_merge, star_cat_merge: record code provenance in the HDF5 attributes

cailmdaley
and
claude
committed
3e269c4