Skip to content

feat(game): stream validation for game metadata#121

Open
Seungpyo1007 wants to merge 9 commits into
mainfrom
feat/game-validation-clean
Open

feat(game): stream validation for game metadata#121
Seungpyo1007 wants to merge 9 commits into
mainfrom
feat/game-validation-clean

Conversation

@Seungpyo1007

@Seungpyo1007 Seungpyo1007 commented Jul 13, 2026

Copy link
Copy Markdown
Member

What & why

Makes game metadata a first-class validated dataset while keeping the million-record import and its CI practical.

  • validates game title, boolean verification status, numeric metrics, classification lists, ESRB values, image URLs, slug uniqueness, and shard paths;
  • streams game records for both python -m app.validate and python -m app.validate --category game, rather than retaining record JSON in memory;
  • runs the full data validator only for data/** changes and main pushes; validator-only PRs run focused unit tests without checking out the million-record dataset; and
  • documents the sparse data workflow, its recovery guardrail, and focused regression tests.

Source

Not applicable: validator and repository-structure work aligned with the existing TechEngine Game model. No TechEngine code or submodule pointer changes.

Checklist

  • Focused game validation unit tests pass locally and in CI
  • Default validation is regression-tested not to call _load(game)
  • Actual la game shard passes streaming validation (1.705s, 2.03MiB peak)
  • Full all-category validator remains required for data/** PRs and main pushes
  • Full game scan uses streaming record iteration rather than retaining record JSON in memory
  • Game paths, slugs, and source URL rules are validated
  • Sparse-index recovery avoids assume-unchanged and skip-worktree

@github-actions github-actions Bot added app Validator or application code changes documentation Improvements or additions to documentation enhancement New feature or request labels Jul 13, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jul 13, 2026
@github-actions github-actions Bot added the ci CI and workflow changes label Jul 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

app Validator or application code changes ci CI and workflow changes documentation Improvements or additions to documentation enhancement New feature or request

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

2 participants