sync with open source how by lesterhaynes · Pull Request #118 · linkedin/beam

lesterhaynes · 2024-03-14T08:15:08Z

Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

* [Gemini] Add client-side throttling to Java Remote Inference * Expose other configuration fields * Apply suggestions from code review Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * argument validation * unit test fix * Docstrings * disable on 0 throttlingDelaySecs --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* initial draft bom workflow * add temp fix * Document new GCP BOM upgrade workflow in README * Fix YAML indentation for push branches trigger * remove tmp push * Rename workflow to Upgrade GCP Libraries BOM * fix gemini comments * move script logic into bomupgrader.py * update workflow logic to only run within 6 days of a release cut

* Update Bigquery Client * fix python style

Fix download_files() in python-release.

Bumps [actions/checkout](https://github.com/actions/checkout) from 6 to 7. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v6...v7) --- updated-dependencies: - dependency-name: actions/checkout dependency-version: '7' dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.22.31 to 1.22.32. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Commits](aws/aws-sdk-go-v2@feature/s3/manager/v1.22.31...feature/s3/manager/v1.22.32) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager dependency-version: 1.22.32 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: damccorm <actions@main-runner-2404-9kmqn-jfwvh.local>

Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.46.0 to 0.47.0. - [Commits](golang/sys@v0.46.0...v0.47.0) --- updated-dependencies: - dependency-name: golang.org/x/sys dependency-version: 0.47.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.50.3 to 1.50.4. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.50.3...pubsub/v1.50.4) --- updated-dependencies: - dependency-name: cloud.google.com/go/pubsub dependency-version: 1.50.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.56.0 to 0.57.0. - [Commits](golang/net@v0.56.0...v0.57.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-version: 0.57.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Derrick Williams <derrickaw@google.com>

* add changelog scanner * sync and spotless * address comments

* add watch for snapshots source * sync * add check for table version * add internal annotation

* (IcebergIO) bugfix: propagate config properties to RecordWriter * Refactor: add new writeProperties option to IcebergWriteSchemaTransformProvider

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.287.1 to 0.288.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](googleapis/google-api-go-client@v0.287.1...v0.288.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-version: 0.288.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

) Bumps [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) from 1.77.0 to 1.78.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.77.0...spanner/v1.78.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/bigquery dependency-version: 1.78.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [github.com/johannesboyne/gofakes3](https://github.com/johannesboyne/gofakes3) from 0.0.0-20250106100439-5c39aecd6999 to 1.2.0. - [Release notes](https://github.com/johannesboyne/gofakes3/releases) - [Commits](https://github.com/johannesboyne/gofakes3/commits/v1.2.0) --- updated-dependencies: - dependency-name: github.com/johannesboyne/gofakes3 dependency-version: 1.2.0 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This allows for httplib2 0.32.0 which includes a fix for CVE-2026-59939. Resolves #39279.

* fix Flink runner tests on Java 21 * fix UnboundedSourceWrapperTest * resolve comments * Apply Spotless

…n Py3 (#39187) * Remove the workaround for pickle * Remove the workaround for pickle

github-actions Bot added build java python examples go infra kotlin learning model labels Mar 14, 2024

njeevan233-spec approved these changes Feb 1, 2026

View reviewed changes

github-actions Bot added java python examples go infra kotlin learning model and removed java python examples go infra kotlin learning model labels Mar 20, 2026

jrmccluskey and others added 30 commits July 8, 2026 09:08

add mongodbio and datadogio to io connectors for yaml (#39223)

401844f

Fix download_files() in python-release.

6170ce6

Quote the url

51b9e4d

update action versions (#39234)

704f7d8

[Python] Add UnboundedSource ValidatesRunner test (#38892)

89fb1dc

Pass --add-opens JVM flags to Spark job server (#39242)

1f4f559

Update Bigquery Client (#38950)

3c28e77

* Update Bigquery Client * fix python style

Merge pull request #39246 from shunping/fix-python-release-scripts

cb9f947

Fix download_files() in python-release.

Update republish_released_docker_containers default release version

eba9ffa

Upgrade GCP Libraries BOM to 26.85.0 (#39243)

1c9175b

Co-authored-by: damccorm <actions@main-runner-2404-9kmqn-jfwvh.local>

[Iceberg CDC] Add Snapshot Changelog Scanner (#38836)

dac4722

* add changelog scanner * sync and spotless * address comments

[Iceberg CDC] Add watch for snapshots source (#38834)

f8b0616

* add watch for snapshots source * sync * add check for table version * add internal annotation

(IcebergIO) bugfix: propagate config properties to RecordWriter (#39250)

668c6a3

* (IcebergIO) bugfix: propagate config properties to RecordWriter * Refactor: add new writeProperties option to IcebergWriteSchemaTransformProvider

Bump httplib2 upper bound to <1.0.0 (#39280)

7d682e2

This allows for httplib2 0.32.0 which includes a fix for CVE-2026-59939. Resolves #39279.

pass --add-opens to Spark PVR test JVM on Java 21 (#39278)

2c92949

Fix Flink runner tests on Java 21 (#39272)

89cc292

* fix Flink runner tests on Java 21 * fix UnboundedSourceWrapperTest * resolve comments * Apply Spotless

Add JVM arguments to fix hadoop-format tests on JDK 17+ (#39283)

63aecf2

Remove previous workarounds for when super() could not be pickled o…

1081d59

…n Py3 (#39187) * Remove the workaround for pickle * Remove the workaround for pickle

Remove redundant argument (#39289)

a3de8e1

Fix Community Metrics Prober job (#39290)

cccb649

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

sync with open source how#118

sync with open source how#118
lesterhaynes wants to merge 9359 commits into
linkedin:li_trunkfrom
apache:master

lesterhaynes commented Mar 14, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Uh oh!

Conversation

lesterhaynes commented Mar 14, 2024

GitHub Actions Tests Status (on master branch)

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants