Skip to content

feat(upload): manage MCAP checksum verification and stored hash #72

Description

@05F3759DF

Context

The final file checksum should be computed and verified during upload, then managed by Keystone or object storage metadata. It should not be written into the MCAP file itself because the checksum is computed after finalization.

Scope

  • Accept or compute the finalized MCAP SHA-256 during upload ingestion.
  • Verify the uploaded MCAP object against the reported checksum when possible.
  • Store checksum, file size, object key, verification status, and verification time in Keystone.
  • Make checksum state available to downstream indexing and operations views.
  • Handle retry or mismatch cases without corrupting existing metadata records.

Acceptance Criteria

  • Keystone stores a verified checksum for MCAP uploads.
  • Checksum mismatch is reported as a failed or quarantined upload state.
  • MCAP metadata extraction does not depend on the checksum being embedded in MCAP.
  • Existing JSON-sidecar uploads remain compatible during migration.
  • Tests cover verified upload, checksum mismatch, missing checksum, retry behavior, and metadata/index interaction.

Related

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:metadataEpisode metadata, provenance, and schema completenessarea:uploadUpload queue, transfer, and sync workflowscross-repo:axonRequires coordination with archebase/axonenhancementNew feature or requestpriority:p1High priority for production operations

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions