Skip to content

Add reusable offline integration test harness - #549

Draft
ppinchuk with Copilot wants to merge 5 commits into
mainfrom
copilot/design-integration-testing-harness
Draft

ppinchuk with Copilot wants to merge 5 commits into
mainfrom
copilot/design-integration-testing-harness

Conversation

Copilot AI commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add strict fixture-driven replay adapters for known URLs, search, website crawlers, redirects, and LLM responses
  • add an offline collection-to-extraction integration scenario with synthetic documents
  • block unexpected network connections and validate every expected interaction is consumed
  • document authoring and validating offline integration scenarios

Validation

  • Python compilation passed for the changed test modules
  • changed files passed secret scanning
  • CodeQL skipped because changes are test-only and documentation-only
  • pytest and Ruff could not run because Pixi was unavailable and sandbox DNS prevented installation

Copilot AI and others added 2 commits August 29, 2026 01:34
Co-authored-by: ppinchuk <28815465+ppinchuk@users.noreply.github.com>
Co-authored-by: ppinchuk <28815465+ppinchuk@users.noreply.github.com>
Co-authored-by: ppinchuk <28815465+ppinchuk@users.noreply.github.com>
Co-authored-by: ppinchuk <28815465+ppinchuk@users.noreply.github.com>
Co-authored-by: ppinchuk <28815465+ppinchuk@users.noreply.github.com>
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 65.65%. Comparing base (8e6195f) to head (3ebe5df).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #549      +/-   ##
==========================================
+ Coverage   65.09%   65.65%   +0.56%     
==========================================
  Files          78       78              
  Lines        7492     7492              
  Branches      754      754              
==========================================
+ Hits         4877     4919      +42     
+ Misses       2454     2404      -50     
- Partials      161      169       +8     
Flag Coverage Δ
unittests 65.65% <ø> (+0.56%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants