Skip to content

Add gcs read benchmark runner - #1

Draft
shradhakatyal wants to merge 14 commits into
mainfrom
add-gcs-read-benchmark-runner
Draft

Add gcs read benchmark runner#1
shradhakatyal wants to merge 14 commits into
mainfrom
add-gcs-read-benchmark-runner

Conversation

@shradhakatyal

Copy link
Copy Markdown
Owner
  • Adds run_benchmark_tests.sh under packages/google-cloud-storage/cloudbuild/ to automate high-bandwidth GCS read microbenchmarks for large objects (10 GiB file sizes).

  • Dynamically updates config.yaml to test multi-process worker pools (PROCESSES=48) across standard REST and BidiReadObject DirectPath gRPC (zonal buckets).

  • Emits structured JSON metrics via --benchmark-json for automated ingestion into Cloud Build CI

@shradhakatyal

Copy link
Copy Markdown
Owner Author

/gcbrun

@shradhakatyal

shradhakatyal commented Aug 25, 2026

Copy link
Copy Markdown
Owner Author

/gcbrun(adaa5b7)

@github-actions

github-actions Bot commented Aug 25, 2026

Copy link
Copy Markdown

⚡ GCS DirectPath Read Performance Benchmark

Status: PASSED | Commit: adb2e006 | Target VM: gcs-benchmark-runner-us-west4-a (c4-standard-192)

Workload Pattern Measured Throughput (MiB/s) Network Bandwidth CPU Usage Status
read_zonal_bidi_grpc Execution Completed See Logs - Passed
📊 Detailed Telemetry & System Information
  • Storage Target: gs://gcs-read-bench-zb-us-west4-a (Zonal Rapid Storage)
  • Transport: BidiReadObject gRPC DirectPath (ALTS)
  • DirectPath gRPC streaming metrics verified.
  • Build Logs: View Cloud Build Execution Logs

@shradhakatyal

Copy link
Copy Markdown
Owner Author

/gcbrun a0823e2

@shradhakatyal

Copy link
Copy Markdown
Owner Author

/gcbrun(a0823e2)

@shradhakatyal
shradhakatyal force-pushed the add-gcs-read-benchmark-runner branch from 6710539 to adb2e00 Compare September 7, 2026 12:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant