apache/beam issues and pull requests

#33568 - DRAFT: Deploy Prism on Kubernetes

Pull Request - State: open - Opened by damondouglas about 1 month ago
Labels: go, docker

#33567 - Blog post and site update for Release 2.62.0

Pull Request - State: closed - Opened by kennknowles about 1 month ago - 3 comments
Labels: website, Next Action: Reviewers

#33566 - feat: caches watermark for Spanner change streams

Pull Request - State: closed - Opened by thiagotnunes about 1 month ago - 2 comments
Labels: java, io, gcp, Next Action: Reviewers, spanner

#33565 - Fix yaml environment cloning for dev branches.

Pull Request - State: closed - Opened by robertwb about 1 month ago - 2 comments
Labels: python, Next Action: Reviewers, yaml

#33562 - Bump github.com/fsouza/fake-gcs-server from 1.49.2 to 1.52.1 in /sdks

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: go, dependencies

#33561 - Fix/enrichment docs #33012

Pull Request - State: open - Opened by Vishesh-Tripathi about 1 month ago - 4 comments
Labels: website, examples, Next Action: Reviewers

#33555 - Upgrade to new vendored grpc

Pull Request - State: closed - Opened by damccorm about 1 month ago - 5 comments
Labels: python, java, build, examples, io, extensions, runners, spark, dataflow, direct, aws, gcp, kafka, core, flink, fn-execution, portability, samza, twister2, spanner

#33554 - [Managed Iceberg] custom equals method for SerializedDataFile

Pull Request - State: closed - Opened by ahmedabu98 about 1 month ago - 8 comments
Labels: java, build, io, Next Action: Reviewers

#33553 - Vendor grpc

Pull Request - State: closed - Opened by damccorm about 1 month ago - 1 comment
Labels: build, vendor

#33547 - Build docker artifacts from self-hosted runners

Pull Request - State: closed - Opened by damccorm about 1 month ago
Labels: build

#33543 - [WIP] [Do not Merge] [Dataflow Streaming] Support for using virtual harness threads

Pull Request - State: open - Opened by arunpandianp about 1 month ago - 3 comments
Labels: build, runners, dataflow

#33542 - [#31438] WindowingStrategy Plumbing + AllowedLateness + Fixing Session Windows

Pull Request - State: closed - Opened by lostluck about 1 month ago - 3 comments
Labels: python, go, runners, prism

#33541 - Pin protobuf 3 for debezium

Pull Request - State: closed - Opened by damccorm about 1 month ago
Labels: java, io, gcp

#33540 - Handle error on source split in BigQueryStorageStreamSource

Pull Request - State: closed - Opened by Abacn about 1 month ago - 3 comments
Labels: java, io, runners, dataflow, gcp, Next Action: Reviewers

#33539 - Add retry logic to each batch method of the GCS IO

Pull Request - State: closed - Opened by sadovnychyi about 1 month ago - 8 comments
Labels: python, io, gcp, Next Action: Reviewers

#33538 - Replace convert_to_typing_type with PEP 585 equivalent

Pull Request - State: open - Opened by jrmccluskey about 1 month ago - 1 comment
Labels: python, Next Action: Reviewers

#33537 - [Task]: Migrate Build Scan publication to develocity.apache.org

Issue - State: closed - Opened by clayburn about 1 month ago - 1 comment
Labels: task, P2

#33536 - [Task]: Add Python documentation for BQ Storage API pipeline options

Issue - State: open - Opened by ahmedabu98 about 1 month ago
Labels: python, java, io, task, P2, awaiting triage

#33535 - Cherry pick for BQIO auto-schema update fix

Pull Request - State: open - Opened by ahmedabu98 about 1 month ago - 2 comments
Labels: java, build, io, gcp

#33534 - Fix #33533 Beam Katas - Java Task placeholder offsets

Pull Request - State: open - Opened by mtrigueira about 1 month ago - 4 comments
Labels: java, learning, Next Action: Reviewers

#33533 - [Bug]: Beam Katas - Java most placeholder offsets broken for at least six months.

Issue - State: open - Opened by mtrigueira about 1 month ago
Labels: P3, bug, awaiting triage

#33532 - Fix: Replace deprecated DataFrame.applymap with map for compatibility

Pull Request - State: open - Opened by Pushkar3119 about 1 month ago - 1 comment
Labels: python, runners

#33531 - [Bug]: BQ TableRow does not accept column named 'f'

Issue - State: open - Opened by RustedBones about 1 month ago - 2 comments
Labels: bug, P2, bigquery

#33530 - Bump com.diffplug.spotless from 5.6.1 to 7.0.1

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: build, dependencies

#33529 - Bump com.diffplug.spotless:spotless-plugin-gradle from 5.6.1 to 7.0.1

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 2 comments
Labels: build, dependencies

#33528 - [WIP] Update just debezium postgres connector

Pull Request - State: closed - Opened by damccorm about 1 month ago - 1 comment
Labels: java, io

#33527 - [Bug]: beam-starter-typescript: npm run build: TypeError: Cannot set property constructor of [object Object] which has only a getter

Issue - State: open - Opened by denis-haskin-elemental about 1 month ago - 2 comments
Labels: examples, typescript, bug, P2, awaiting triage

#33526 - [WIP] Upgrade version of io.debezium

Pull Request - State: closed - Opened by damccorm about 1 month ago - 1 comment
Labels: java, build, io, gcp

#33525 - Pin protobuf for older hadoop tests

Pull Request - State: closed - Opened by damccorm about 1 month ago - 2 comments
Labels: java, build, io, hadoop

#33524 - [#33449] Return zero elements immediately if the requested number of quantiles is 1.

Pull Request - State: closed - Opened by Labutin about 1 month ago - 1 comment
Labels: go, Next Action: Reviewers

#33523 - Update Python typehints in Beam YAML

Pull Request - State: closed - Opened by jrmccluskey about 1 month ago - 2 comments
Labels: python, Next Action: Reviewers, yaml

#33522 - Improve memory efficiency in FnApiDoFnRunner

Pull Request - State: closed - Opened by stankiewicz about 1 month ago - 4 comments
Labels: java, Next Action: Reviewers

#33521 - [Spark] Restore memory sensitive GBK translation (#33520)

Pull Request - State: closed - Opened by JozoVilcek about 1 month ago - 6 comments
Labels: runners, spark, Next Action: Reviewers

#33520 - [Bug]: GBK operation fails on OutOfMemory with SparkRunner

Issue - State: closed - Opened by JozoVilcek about 1 month ago
Labels: spark, bug, P2, awaiting triage

#33519 - Bump github.com/fsouza/fake-gcs-server from 1.49.2 to 1.51.0 in /sdks

Pull Request - State: open - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: go, dependencies

#33518 - Bump com.diffplug.spotless:spotless-plugin-gradle from 5.6.1 to 7.0.0

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 2 comments
Labels: build, dependencies

#33517 - Bump com.diffplug.spotless from 5.6.1 to 7.0.0

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 2 comments
Labels: build, dependencies

#33516 - Documents the connectors supported via the Managed API

Pull Request - State: closed - Opened by chamikaramj about 2 months ago - 2 comments
Labels: website, Next Action: Reviewers

#33515 - [#33513][prism]Handle Time sorted requirement and drop late data.

Pull Request - State: closed - Opened by lostluck about 2 months ago - 6 comments
Labels: java, go, runners, Next Action: Reviewers, prism

#33514 - Fix log spam when using a JdbcIO DataSource not support Lineage report

Pull Request - State: closed - Opened by Abacn about 2 months ago - 1 comment
Labels: java, io, jdbc, Next Action: Reviewers

#33513 - [prism] Support SortedTime input (java annotation & requirement)

Issue - State: closed - Opened by lostluck about 2 months ago - 1 comment
Labels: go, runners, prism

#33512 - [Dataflow Streaming] Support to receive multiple work items in a single StreamingGetWorkResponseChunk

Pull Request - State: open - Opened by arunpandianp about 2 months ago - 2 comments
Labels: runners, dataflow

#33511 - [Managed Iceberg] support BQMS catalog

Pull Request - State: open - Opened by ahmedabu98 about 2 months ago - 3 comments
Labels: java, build, io, Next Action: Reviewers

#33510 - Clean up py38 targets

Pull Request - State: closed - Opened by Abacn about 2 months ago - 4 comments
Labels: python, build, infra, Next Action: Reviewers

#33509 - [Iceberg] cleanup FileIO resources

Pull Request - State: closed - Opened by ahmedabu98 about 2 months ago - 2 comments
Labels: java, build, io, Next Action: Reviewers

#33508 - Support use staged harness for Dataflow runner v2 job

Pull Request - State: open - Opened by Abacn about 2 months ago - 1 comment
Labels: java, docker, Next Action: Reviewers

#33507 - Use self-hosted runners for republish workflow

Pull Request - State: open - Opened by damccorm about 2 months ago - 3 comments
Labels: build

#33506 - [Bug]: Building wheels failing on self hosted actions, working on github's runners

Issue - State: open - Opened by damccorm about 2 months ago - 3 comments
Labels: python, infra, bug, P2

#33504 - [Managed Iceberg] unbounded source

Pull Request - State: open - Opened by ahmedabu98 about 2 months ago - 3 comments
Labels: java, build, io

#33503 - Kafka add counters v1 uw2

Pull Request - State: open - Opened by Naireen about 2 months ago - 34 comments
Labels: java, model, io, runners, kafka, core, Next Action: Reviewers, slow-review

#33502 - Update 2024.md

Pull Request - State: closed - Opened by liferoad about 2 months ago - 1 comment
Labels: Next Action: Reviewers

#33500 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.71.0 to 1.72.0 in /sdks

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: go, dependencies, Next Action: Reviewers

#33499 - Performance Regression or Improvement: test_cloudml_benchmark_criteo_10GB-runtime_sec:runtime_sec

Issue - State: closed - Opened by github-actions[bot] about 2 months ago
Labels: awaiting triage, perf-alert

#33498 - [Bug]: JDBC Url INFO logging

Issue - State: closed - Opened by daniel-deychakiwsky about 2 months ago - 2 comments
Labels: python, java, P3, bug, awaiting triage

#33497 - [Bug]: Managed IO for Iceberg cannot query by partition

Issue - State: open - Opened by saathwik-tk about 2 months ago - 4 comments
Labels: java, bug, P2, awaiting triage

#33496 - Performance Regression or Improvement: gbk_python_batch_load_test_fanout_8_times_with_2GB_10byte_records_total:runtime

Issue - State: closed - Opened by github-actions[bot] about 2 months ago
Labels: awaiting triage, perf-alert

#33495 - Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec

Issue - State: closed - Opened by github-actions[bot] about 2 months ago
Labels: awaiting triage, perf-alert

#33494 - [Distroless] Reorganize and refactor Distroless build and test details

Pull Request - State: open - Opened by damondouglas about 2 months ago - 2 comments
Labels: python, java, build, docker, runners, dataflow, Next Action: Reviewers

#33493 - [#31912] Fix bug in finalization for Prism & fix the Java bundle finalizing tests.

Pull Request - State: open - Opened by lostluck about 2 months ago - 2 comments
Labels: java, go, runners, prism

#33492 - Update REVIEWERS.yml with the BigTable team

Pull Request - State: closed - Opened by liferoad about 2 months ago - 1 comment
Labels: build, Next Action: Reviewers

#33491 - Test wheels build with less parallel.

Pull Request - State: closed - Opened by claudevdm about 2 months ago
Labels: build

#33490 - Upgrade protobuf in vendored grpc

Pull Request - State: open - Opened by damccorm about 2 months ago
Labels: build

#33489 - Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.71.0 to 1.71.1 in /sdks

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 2 comments
Labels: go, dependencies, Next Action: Reviewers

#33488 - Bump cloud.google.com/go/bigtable from 1.33.0 to 1.34.0 in /sdks

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 2 comments
Labels: go, dependencies

#33487 - Better error message on incorrect package listing.

Pull Request - State: closed - Opened by robertwb about 2 months ago - 3 comments
Labels: python, Next Action: Reviewers, yaml

#33486 - Fix bounded trie merge when merging on empty trie

Pull Request - State: closed - Opened by rohitsinha54 about 2 months ago - 4 comments
Labels: python

#33485 - [Distroless] Publish Java SDK distroless variants

Pull Request - State: closed - Opened by damondouglas about 2 months ago - 1 comment
Labels: build, Next Action: Reviewers

#33484 - [Distroless] Publish Python distroless variants

Pull Request - State: open - Opened by damondouglas about 2 months ago - 1 comment
Labels: build, Next Action: Reviewers

#33483 - Fix bounded trie merge when merging on empty trie

Pull Request - State: closed - Opened by rohitsinha54 about 2 months ago - 5 comments
Labels: python

#33482 - Place bounded lineage metrics under a new name.

Pull Request - State: closed - Opened by robertwb about 2 months ago - 4 comments
Labels: python

#33481 - Revert "Stage beam_Publish_Python_SDK_Distroless_Snapshots.yml"

Pull Request - State: open - Opened by damccorm about 2 months ago
Labels: build

#33480 - Update BEAM_DEV_SDK_CONTAINER_TAG for deps update.

Pull Request - State: closed - Opened by claudevdm about 2 months ago - 2 comments
Labels: python, runners

#33479 - [Release-2.62] cherry-pick #33472 into release branch

Pull Request - State: closed - Opened by Abacn about 2 months ago - 4 comments
Labels: java, io, extensions, sql, gcp

#33478 - [Bug]: Reading Kinesis' stream shards fails when the number of shards is greater than 1000

Issue - State: open - Opened by Adrjanjan about 2 months ago
Labels: bug, P2, awaiting triage

#33477 - Add descriptive tags to republished containers

Pull Request - State: closed - Opened by damccorm about 2 months ago - 3 comments
Labels: build, Next Action: Reviewers

#33476 - Revert "Update Java expansion service to use distroless"

Pull Request - State: closed - Opened by damccorm about 2 months ago - 2 comments
Labels: java

#33475 - The go_modules in /sdks - Update #941920271 job is flaky

Issue - State: closed - Opened by github-actions[bot] about 2 months ago - 1 comment
Labels: P1, bug, flaky_test, workflow_id: 131702530

#33474 - Add support for bounded trie metric in legacy worker

Pull Request - State: closed - Opened by rohitsinha54 about 2 months ago - 13 comments
Labels: java, runners, dataflow, core, Next Action: Reviewers

#33473 - Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet152-GPU-mean_load_model_latency_milli_secs:mean_load_model_latency_milli_secs

Issue - State: closed - Opened by github-actions[bot] about 2 months ago
Labels: awaiting triage, perf-alert

#33472 - Make Beam expansion service shadowJar multi-release

Pull Request - State: closed - Opened by Abacn about 2 months ago - 3 comments
Labels: java, io, extensions, sql, gcp

#33471 - [Bug]: org.xbill.DNS.spi.DnsjavaInetAddressResolverProvider when running multi-lang Python jobs on Dataflow with Java 21

Issue - State: closed - Opened by chamikaramj about 2 months ago - 5 comments
Labels: P1, bug

GitHub / apache/beam issues and pull requests