Skip to content

test: add model output consistency checks - #22

Merged
phiscu merged 3 commits into
masterfrom
test-foundation-1.0.2
Aug 3, 2026
Merged

test: add model output consistency checks#22
phiscu merged 3 commits into
masterfrom
test-foundation-1.0.2

Conversation

@phiscu

@phiscu phiscu commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Summary

This pull request establishes reproducible model output checks for MATILDA 1.0.2.

It:

  • adds a pinned Python 3.11 test environment;
  • compares the maintained 2000–2020 glacier-evolution scenario with the existing numerical reference;
  • verifies the public output structure, numerical tables, KGE, summary statistics, and glacier-
    evolution outputs;
  • produces variable-level and annual reports that quantify the effect of future model changes;
  • checks package version metadata, parameter defaults, public imports, and wheel contents;
  • runs the checks in GitHub Actions.

Purpose

The tests record the current model behavior before changes are made to the core routines. The reports
show which variables, processes, and years are affected by a future change. This helps determine which
simulations, figures, tables, or calibrations need to be repeated.

Validation

  • Test suite: 8 passed
  • The maintained numerical scenario matches the reference exactly.
  • Wheel-content verification passed.
  • No scientific model routine or equation was changed.

The current reference covers one long glacier-evolution scenario. Additional synthetic edge-case and
calibration tests will be added separately.

@phiscu
phiscu merged commit 1de136e into master Aug 3, 2026
1 check passed
@phiscu
phiscu deleted the test-foundation-1.0.2 branch August 3, 2026 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant