Skip to content

fix(test): add CI validation for test snapshots to prevent silent drift - #340

Merged
ALLEN-AYODEJI merged 1 commit into
Trellis-Ecosystem:masterfrom
samuel22x:fix/test-snapshot-validation
Aug 28, 2026
Merged

fix(test): add CI validation for test snapshots to prevent silent drift#340
ALLEN-AYODEJI merged 1 commit into
Trellis-Ecosystem:masterfrom
samuel22x:fix/test-snapshot-validation

Conversation

@samuel22x

Copy link
Copy Markdown
Contributor
  • Add 'Validate test snapshots are up to date' step in contract-ci.yml: regenerates snapshots with SOROBAN_TEST_SNAPSHOT_FILE=overwrite then fails with a clear message if git diff detects any change.
  • Add 'test-snapshots-update' Makefile target so developers can regenerate snapshots locally before opening a PR.
  • Add Section 10 'Test Snapshots' to CONTRIBUTING.md explaining why snapshots are tracked, how to regenerate them, and what the CI check does; renumber subsequent sections 11-14 accordingly.
  • Add PR checklist item for snapshot regeneration to .github/PULL_REQUEST_TEMPLATE.md.

Description

Related Issues

Closes #

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Documentation
  • Infrastructure / tooling

Testing Done

Screenshots (if UI)

Checklist

  • Code follows the project's style guidelines
  • Tests pass locally
  • Documentation updated (README, DEPLOYMENT.md, doc comments) if user-facing
  • No breaking changes without prior notice in the description above

See CONTRIBUTING.md for detailed guidelines. Commit messages should follow Conventional Commits format (e.g. fix(infra): ...) since PRs are squash-merged.

closes #144

- Add 'Validate test snapshots are up to date' step in contract-ci.yml:
  regenerates snapshots with SOROBAN_TEST_SNAPSHOT_FILE=overwrite then
  fails with a clear message if git diff detects any change.
- Add 'test-snapshots-update' Makefile target so developers can
  regenerate snapshots locally before opening a PR.
- Add Section 10 'Test Snapshots' to CONTRIBUTING.md explaining why
  snapshots are tracked, how to regenerate them, and what the CI check
  does; renumber subsequent sections 11-14 accordingly.
- Add PR checklist item for snapshot regeneration to
  .github/PULL_REQUEST_TEMPLATE.md.
@drips-wave

drips-wave Bot commented Aug 26, 2026

Copy link
Copy Markdown

@samuel22x Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

@ALLEN-AYODEJI
ALLEN-AYODEJI merged commit d2e844b into Trellis-Ecosystem:master Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Silent snapshot drift: test snapshot files are never validated in CI allowing unnoticed regressions

2 participants