GoogleCloudPlatform/dataproc-templates issues and pull requests

#1026 - feat!: GCS to BigTable catalog from GCS bucket

Pull Request - State: open - Opened by rajc242 11 days ago
Labels: enhancement, python

#1025 - chore(deps): bump com.google.protobuf:protobuf-java from 3.25.0 to 3.25.5 in /java

Pull Request - State: open - Opened by dependabot[bot] 11 days ago
Labels: java, dependencies

#1024 - fix: Jenkins optimisation update

Pull Request - State: closed - Opened by hhasija 12 days ago - 1 comment

#1023 - fix: Provide required protobuf-java dependency for spanner

Pull Request - State: closed - Opened by rajc242 13 days ago
Labels: enhancement, java

#1022 - [Fix] Spanner JDBC driver requires protobuf version which provides MapFieldReflectionAccessor

Issue - State: closed - Opened by rajc242 13 days ago
Labels: enhancement, java

#1021 - feat: bigquery_jdbc_blog

Pull Request - State: closed - Opened by hhasija 14 days ago

#1020 - fix: adding blogpost link for BigQuery to JDBC

Pull Request - State: closed - Opened by hhasija 14 days ago

#1019 - feat!: Allow the Elasticsearch Authorization using API Key

Pull Request - State: closed - Opened by rohilla-anuj 16 days ago - 1 comment
Labels: enhancement, python

#1018 - [Enhancement] Add delta file support for templates which Have GCS as source or target

Issue - State: open - Opened by surjits254 20 days ago
Labels: enhancement, python

#1017 - [Enhancement] Add delta file support for templates which Have GCS as source or target

Issue - State: open - Opened by surjits254 20 days ago
Labels: enhancement, java

#1016 - fix: jenkins integration tests optimisation

Pull Request - State: closed - Opened by hhasija 21 days ago - 2 comments

#1015 - fix: adding if else condition for jenkins optimisation

Pull Request - State: closed - Opened by hhasija 21 days ago

#1014 - fix: adding csv support for gcs to spanner template

Pull Request - State: closed - Opened by hhasija 22 days ago - 2 comments

#1013 - [Enhancement] UI and Public doc

Issue - State: open - Opened by surjits254 24 days ago
Labels: enhancement, UI

#1013 - [Enhancement] UI and Public doc

Issue - State: open - Opened by surjits254 24 days ago
Labels: enhancement, UI

#1012 - Verify output of PubSub Templates

Issue - State: open - Opened by surjits254 24 days ago
Labels: java, tech-debt

#1012 - Verify output of PubSub Templates

Issue - State: open - Opened by surjits254 24 days ago
Labels: java, tech-debt

#1011 - [Enhancement] GCS to spanner add CSV support

Issue - State: closed - Opened by surjits254 24 days ago
Labels: enhancement, java

#1011 - [Enhancement] GCS to spanner add CSV support

Issue - State: closed - Opened by surjits254 24 days ago
Labels: enhancement, java

#1010 - [Enhancement] GCS to BQ Add write mode

Issue - State: open - Opened by surjits254 24 days ago
Labels: enhancement, java

#1009 - chore(main): release 2.0.0-beta

Pull Request - State: open - Opened by release-please[bot] 29 days ago
Labels: autorelease: pending

#1008 - chore(main): release 1.0.2-beta

Pull Request - State: closed - Opened by release-please[bot] about 1 month ago - 1 comment
Labels: autorelease: tagged

#1008 - chore(main): release 1.0.2-beta

Pull Request - State: closed - Opened by release-please[bot] about 1 month ago - 1 comment
Labels: autorelease: tagged

#1007 - fix: java mvn version

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1007 - fix: java mvn version

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1006 - chore(main): release 1.0.1-beta

Pull Request - State: closed - Opened by release-please[bot] about 1 month ago - 1 comment
Labels: autorelease: tagged

#1006 - chore(main): release 1.0.1-beta

Pull Request - State: closed - Opened by release-please[bot] about 1 month ago - 1 comment
Labels: autorelease: tagged

#1005 - fix: update build versions for Java and Python

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1005 - fix: update build versions for Java and Python

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1004 - feat!: Use spark bigtable connector instead of hbase connector

Pull Request - State: closed - Opened by rohilla-anuj about 1 month ago - 1 comment
Labels: enhancement, python

#1003 - fix: s3 integ tests

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1002 - fix: commented hbase integ test for short time

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#1001 - feat: Add integration test for MySQL2Spanner notebook

Pull Request - State: open - Opened by NiloFreitas about 1 month ago
Labels: Notebook

#1000 - feat: BigQuery_To_JDBC

Pull Request - State: closed - Opened by hhasija about 1 month ago - 2 comments
Labels: enhancement, java

#999 - feat: [New Template] [Java] BigQuery To JDBC

Pull Request - State: closed - Opened by hhasija about 1 month ago

#998 - Verify Python build versions and requirements

Issue - State: open - Opened by surjits254 about 1 month ago
Labels: python, tech-debt

#997 - [Automation] Recreate Hbase cluster for integration tests

Issue - State: open - Opened by shashank-google about 1 month ago
Labels: automation

#996 - [Enhancement] Enhance PR integration test to run for specific language

Issue - State: closed - Opened by surjits254 about 1 month ago - 1 comment
Labels: enhancement, automation

#995 - feat: 965 upgrade dataproc serverless version to 1.2 python

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#994 - [Enhancement] Python Integration test to create uuidgen folder for each PR run

Issue - State: open - Opened by surjits254 about 1 month ago
Labels: enhancement, automation

#993 - [Enhancemement] Upgrade Kafka and Hbase templates to version 1.2

Issue - State: open - Opened by surjits254 about 1 month ago
Labels: enhancement, python

#992 - [Enhancemement] Upgrade ES templates to version 1.2

Issue - State: closed - Opened by surjits254 about 1 month ago - 4 comments
Labels: enhancement, python

#991 - [Enhancement] Bigtable and hbase templates accept catalog from a file on GCS

Issue - State: open - Opened by surjits254 about 1 month ago
Labels: enhancement, python

#990 - feat: upgrade dataproc serverless version to 1.2 python

Pull Request - State: closed - Opened by surjits254 about 1 month ago

#989 - feat!: Use spark bigtable connector instead of hbase

Pull Request - State: closed - Opened by rajc242 about 1 month ago
Labels: python

#988 - Deprecate redshift template

Issue - State: closed - Opened by shashank-google about 2 months ago
Labels: documentation

#987 - Add AWS S3 Integration Test

Issue - State: closed - Opened by shashank-google about 2 months ago
Labels: automation

#986 - [New Template] [Java] BigQuery To JDBC

Issue - State: closed - Opened by shashank-google about 2 months ago - 1 comment
Labels: new-template, java

#985 - fix: Deprecate TextToBigQuery and PubsubliteToBigTable

Pull Request - State: closed - Opened by rajc242 about 2 months ago
Labels: java

#984 - [Fix] Deprecate pubsublite and text based templates

Issue - State: closed - Opened by rajc242 about 2 months ago
Labels: java

#983 - ci: fix setup.py for pypi release

Pull Request - State: closed - Opened by vanshaj-bhatia about 2 months ago

#982 - ci: AWS integration test

Pull Request - State: closed - Opened by shashank-google about 2 months ago

#981 - [Automation] Use same java build across all the integration tests in a given PR / Merge

Issue - State: closed - Opened by shashank-google about 2 months ago - 1 comment
Labels: automation

#980 - fix: avro path fix for cluster mode

Pull Request - State: closed - Opened by rajc242 about 2 months ago
Labels: java

#979 - [Fix] Cluster mode avro library location for java templates

Pull Request - State: closed - Opened by rajc242 about 2 months ago

#978 - ci: fix for jar deletion

Pull Request - State: closed - Opened by vanshaj-bhatia about 2 months ago

#977 - ci: run UI integration tests as part of every PR

Pull Request - State: closed - Opened by vanshaj-bhatia about 2 months ago

#976 - [Fix] Cluster mode avro library location for java templates

Issue - State: closed - Opened by rajc242 about 2 months ago
Labels: java

#975 - [enhancement] Add integration tests to PR and release PR

Issue - State: closed - Opened by surjits254 about 2 months ago
Labels: enhancement, automation

#974 - [fix] Python public binaries build

Issue - State: closed - Opened by surjits254 about 2 months ago

#973 - fix: revert "ci: ui integration test for release"

Pull Request - State: closed - Opened by vanshaj-bhatia about 2 months ago

#972 - fix: rebalanced integrations tests

Pull Request - State: closed - Opened by shashank-google about 2 months ago

#971 - [Enhancement] Update java templates to use JDK 17 and Spark 3.5.1

Issue - State: open - Opened by rajc242 about 2 months ago
Labels: enhancement, java

#970 - chore(deps): bump commons-io:commons-io from 2.13.0 to 2.14.0 in /java

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: java, dependencies

#969 - [Testing] JDBC to Spanner template to use the PostgreSQL dialect of the Spanner driver.

Issue - State: open - Opened by nehamodgil about 2 months ago
Labels: smt-integration

#968 - [Java] Implement Lenient JDBC Writer for Dataproc

Issue - State: open - Opened by nehamodgil about 2 months ago
Labels: enhancement, smt-integration

#967 - [Enhancement] Update GCS to BigTable python template to use spark bigtable connector

Issue - State: closed - Opened by rajc242 about 2 months ago
Labels: enhancement, python

#966 - Add cluster integration test on PR merge

Issue - State: closed - Opened by surjits254 about 2 months ago - 1 comment
Labels: automation

#965 - Upgrade dataproc serverless version to 1.2 Python

Issue - State: closed - Opened by surjits254 about 2 months ago - 1 comment
Labels: python, high-priority, dependencies

#964 - ci: 906 UI templates integration tests and cicd

Pull Request - State: closed - Opened by surjits254 about 2 months ago - 1 comment

#963 - feat: Initial commit for Spark runtime update to 1.2

Pull Request - State: closed - Opened by rajc242 about 2 months ago
Labels: enhancement, java, dependencies

#962 - ci: ui integration test for release

Pull Request - State: closed - Opened by vanshaj-bhatia about 2 months ago

#961 - chore(deps): bump org.apache.hadoop:hadoop-common from 3.2.4 to 3.4.0 in /java

Pull Request - State: closed - Opened by dependabot[bot] 2 months ago - 1 comment
Labels: java, dependencies

#960 - [Java] [Integration Tests] Move all the gcs input files as part of codebase

Issue - State: open - Opened by shashank-google 2 months ago
Labels: java, automation

#959 - change python dataproc version to 1.2

Pull Request - State: closed - Opened by surjits254 2 months ago

#958 - feat!: GCS to BigTable multiple column family ingestion

Pull Request - State: closed - Opened by rajc242 2 months ago

#957 - feat: Spanner JDBC driver can use postgresql dialect

Pull Request - State: closed - Opened by rajc242 2 months ago

#956 - [Documentation] Check write mode for all java/python templates writing to BigQuery

Issue - State: open - Opened by rajc242 2 months ago
Labels: documentation, python, java

#955 - [Enhancement] Update java templates pom.xml file to use spark bigquery connector from maven

Issue - State: closed - Opened by rajc242 2 months ago - 1 comment
Labels: enhancement, java

#954 - feat: Mongo To BigQuery java template

Pull Request - State: closed - Opened by rajc242 2 months ago
Labels: enhancement, java

#953 - chore(main): release 1.0.0-beta

Pull Request - State: closed - Opened by release-please[bot] 3 months ago - 1 comment
Labels: autorelease: tagged

#952 - fix: Query syntax

Pull Request - State: closed - Opened by rajc242 3 months ago
Labels: bug, Notebook

#951 - fix: Revert chore(main) release 0.6.0-beta

Pull Request - State: closed - Opened by shashank-google 3 months ago

#950 - [Notebook] Fix query syntax for postgresql-to-bigquery-notebook.ipynb file

Issue - State: closed - Opened by rajc242 3 months ago
Labels: bug, Notebook

#949 - fix: notebook notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb

Pull Request - State: closed - Opened by eder001 3 months ago

#948 - fix: notebook notebooks/postgresql2bq/postgresql-to-bigquery-notebook.ipynb

Pull Request - State: closed - Opened by eder001 3 months ago - 1 comment

#947 - docs: test ci/cd

Pull Request - State: closed - Opened by shashank-google 3 months ago

#947 - docs: test ci/cd

Pull Request - State: closed - Opened by shashank-google 3 months ago

#946 - chore(deps): bump cryptography from 41.0.4 to 43.0.1 in /.kokoro

Pull Request - State: closed - Opened by dependabot[bot] 3 months ago
Labels: python, dependencies

#945 - docs: provide steps to setup packages for notebook to run in colab

Pull Request - State: closed - Opened by rajc242 3 months ago

#945 - docs: provide steps to setup packages for notebook to run in colab

Pull Request - State: closed - Opened by rajc242 3 months ago

#944 - [Publishing] [Notebook] Update README file to provide colab specific steps

Issue - State: closed - Opened by rajc242 3 months ago
Labels: publishing, Notebook

#944 - [Publishing] [Notebook] Update README file to provide colab specific steps

Issue - State: closed - Opened by rajc242 3 months ago
Labels: publishing, Notebook

#943 - [Publishing] [Java] Blog for Kafka to PubSub using Dataproc Serverless

Issue - State: open - Opened by violetautumn 3 months ago
Labels: publishing, java

#943 - [Publishing] [Java] Blog for Kafka to PubSub using Dataproc Serverless

Issue - State: closed - Opened by violetautumn 3 months ago - 1 comment
Labels: publishing, java

#942 - [Publishing] [Java] Blog for WordCount example

Issue - State: open - Opened by violetautumn 3 months ago - 1 comment
Labels: publishing, java

#942 - [Publishing] [Java] Blog for WordCount example

Issue - State: open - Opened by violetautumn 3 months ago
Labels: publishing, java

#941 - docs: adding blog link to main readme

Pull Request - State: closed - Opened by violetautumn 3 months ago

#940 - feat: MySqlToSapanner_notebook integration with colab enterprise

Pull Request - State: closed - Opened by rajc242 3 months ago

#940 - feat: MySqlToSapanner_notebook integration with colab enterprise

Pull Request - State: closed - Opened by rajc242 3 months ago

GitHub / GoogleCloudPlatform/dataproc-templates issues and pull requests