Controlled study: does continued pre-training on SEC 10-K filings help downstream financial QA? A clean negative result on a fair evaluation instrument. Qwen2.5-3B; FinQA/TAT-QA; CPT (LoRA and full-parameter), SFT, DPO.
nlp reproducible-research lora domain-adaptation peft dpo negative-results financial-nlp large-language-models qwen continued-pretraining supervised-fine-tuning finqa financial-qa tatqa
-
Updated
Jun 18, 2026 - Python