perf: reduce exporter memory footprint with disk staging and streaming generation - #5919

Merged

another-rex merged 14 commits into

google:masterfrom

another-rex:optimize_exporter_memory

Aug 27, 2026

Commits on Aug 26, 2026

feat(clients): add WriteObjectStream to CloudStorage interface and GCSClient
another-rex
committed
348f724
perf(exporter): stream zip/csv generation and use disk-backed scratch staging
another-rex
committed
b399b14
perf(deploy): rightsize exporter resources, allocate scratch volume, and move to default pool
another-rex
committed
ff7b7d3
refactor(exporter): simplify scratchDir handling, remove localPath from vulnMeta, and write CSV/Vanir in-memory
another-rex
committed
04a2d44
refactor(exporter): parallelize downloading and processing into downloadThenProcessor, stream cleanups, and fast-fail on disk error
another-rex
committed
bd115f2
refactor(exporter): stream Vanir signature json generation directly from scratch disk
another-rex
committed
1f37b68
refactor(exporter): build Vanir signature json in memory from disk files
another-rex
committed
09c45a5
refactor(exporter): split writer into writeFromFile and writeFromMemory helper functions
another-rex
committed
5117f80
test(exporter): fix slice preallocation lint finding and document go linter in AGENTS.md
another-rex
committed
e091a6b
refactor(exporter): use time.Time in csvEntry struct and CSV sorting/formatting
another-rex
committed
6fe952e
refactor(exporter): address PR review comments - add range break and remove file deletion in writer
another-rex
committed
607ba3d

Commits on Aug 27, 2026