Skip to content

[codex] Add frozen metadata scenario#816

Merged
bill-ph merged 1 commit into
mainfrom
codex/scenario-runner-pr4
Jun 26, 2026
Merged

[codex] Add frozen metadata scenario#816
bill-ph merged 1 commit into
mainfrom
codex/scenario-runner-pr4

Conversation

@bill-ph

@bill-ph bill-ph commented Jun 26, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds the dev scenario runner coverage for the frozen metadata exploration path.

  • add a posthog_frozen_metadata scenario that provisions a temporary warehouse, creates DuckDB views over a frozen dataset URI supplied by environment, runs metadata/catalog queries, and deprovisions the warehouse
  • add SQL file and catalog-file support needed by the scenario, including ${env:NAME} template resolution and min_rows assertions
  • make scenario execution path-stable when launched through scripts/scenario_run.sh / just scenario-frozen-metadata
  • update the scenario runner runbook and mark the old prod perf harness path as legacy while this dev runner replaces it

Validation

  • go test ./tests/scenario/...
  • go test ./tests/scenario/... ./tests/perf/...
  • just test-scenario
  • just lint
  • git diff --check

I did not run the live dev frozen scenario in this checkout because the live scenario API/PG environment is not configured here. The scenario also requires the provisioned Duckgres worker role to have read/list access to the configured frozen dataset prefix.

@github-actions

Copy link
Copy Markdown

Test Impact Plan

Deterministic summary of how this PR changes tests, CI runners, and coverage-risk signals.

Summary

Area Added Changed Deleted
Test files 4 5 0
E2E/journey files 0 0 0
Workflow files 0 0 0

Signals

  • Test cases: +9 / -0
  • Assertions: +39 / -0
  • Skips or known failures added: 0
  • Workflow continue-on-error added: 0
  • Workflow path filters added: 0
  • Test commands removed from justfile: 0
  • E2E/journey retry lines added: 0

Coverage risk: neutral or increased

No coverage-reduction warnings detected.

@bill-ph bill-ph marked this pull request as ready for review June 26, 2026 13:44
@bill-ph bill-ph merged commit e540579 into main Jun 26, 2026
28 checks passed
@bill-ph bill-ph deleted the codex/scenario-runner-pr4 branch June 26, 2026 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant