Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / GoogleCloudDataproc/spark-bigquery-connector issues and pull requests

#1112 - The property `bigQueryTableLabel` of the connector seems not working

Issue - State: closed - Opened by xtrmstep about 1 year ago - 1 comment

#1111 - Enable retry of failed messages.

Pull Request - State: closed - Opened by agrawal-siddharth about 1 year ago - 1 comment

#1110 - Specify dynamic partition overwrite in changes.md

Pull Request - State: closed - Opened by isha97 about 1 year ago

#1109 - Enable read-session caching by default for faster Spark planning

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 4 comments

#1108 - updating the readme

Pull Request - State: closed - Opened by suryasoma about 1 year ago

#1107 - Fix code samples for jupyter notebook in readme-template

Pull Request - State: closed - Opened by isha97 about 1 year ago

#1106 - Fixing the nightly build

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 1 comment

#1105 - add missing backslashes for multi-line python example

Pull Request - State: closed - Opened by mcorrig4 about 1 year ago - 1 comment

#1104 - Fixed nested field predicate pushdown

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 3 comments

#1103 - Fix documentation for intermediateFormat property

Pull Request - State: closed - Opened by isha97 about 1 year ago

#1102 - Issue #1099: Fixing the usage of ExternalAccountCredentials

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 4 comments

#1101 - Support Dynamic Partition Overwrite for Indirect write

Pull Request - State: closed - Opened by isha97 about 1 year ago - 10 comments

#1100 - Bad string encoding while reading from BQ

Issue - State: closed - Opened by x-o-r about 1 year ago - 4 comments

#1099 - NPE when using workload identity federation to fetch table

Issue - State: closed - Opened by zhz125 about 1 year ago - 1 comment

#1097 - Upgraded dependencies

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 2 comments

#1096 - Support Dynamic Partition Overwrite [DIRECT write, Range Partitioning]

Pull Request - State: closed - Opened by isha97 about 1 year ago - 3 comments

#1095 - CVE-2023-4586: Upgrading the netty dependencies

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 2 comments

#1094 - CVE-2023-5072: Upgrading the org.json:json dependency

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 7 comments

#1093 - Removing code duplications

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 5 comments

#1092 - Disabling broken writeStream acceptance test

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 1 comment

#1091 - Temp table cleanup

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 1 comment

#1090 - Issue #1062: Adding dataproc job ID and UUID labels to BigQuery jobs

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 1 comment

#1089 - Updating docs

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago

#1087 - Issue #103: Support Dynamic Partition Overwrite [DIRECT write, Time Partitioning]

Pull Request - State: closed - Opened by isha97 about 1 year ago - 9 comments

#1086 - BigQuery Write API cannot use BigQuery CDC feature

Issue - State: open - Opened by jster1357 about 1 year ago
Labels: enhancement

#1085 - remove Scala 2.11 from the nightly build

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago

#1084 - Document allowMapTypeConversion flag

Pull Request - State: closed - Opened by isha97 about 1 year ago - 3 comments

#1083 - upload the spark-bigquery-metrics*.jar to GCS in nightly build

Pull Request - State: closed - Opened by isha97 about 1 year ago - 1 comment

#1082 - [WIP] request snappy compression of ReadRowsResponse and decompress compressed messages

Pull Request - State: closed - Opened by yqiu2 about 1 year ago - 3 comments

#1081 - Estimate stats faster for unbuilt scans

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 1 comment

#1080 - Reordering the integration tests ion the presubmit for faster execution

Pull Request - State: closed - Opened by isha97 about 1 year ago - 2 comments

#1079 - Issue #1046: Allow disabling automatic Map conversion

Pull Request - State: closed - Opened by isha97 about 1 year ago - 4 comments

#1078 - Issue #1062: Adding dataproc job ID and UUID labels to BigQuery jobs

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 4 comments

#1077 - Avoid empty partitions during DPP

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 3 comments

#1076 - Fix the integration test for spark 3.4

Pull Request - State: closed - Opened by isha97 about 1 year ago - 2 comments

#1075 - Add 3.4 build and tests as part of cloudbuild

Pull Request - State: closed - Opened by isha97 about 1 year ago - 1 comment

#1074 - Bump org.apache.avro:avro from 1.11.1 to 1.11.3 in /spark-bigquery-parent

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 2 comments
Labels: dependencies

#1073 - Document specifying the connector version in Dataproc cluster

Pull Request - State: closed - Opened by isha97 about 1 year ago - 2 comments

#1072 - Spark Write BIGNUMERIC issue

Issue - State: closed - Opened by lucaracca about 1 year ago - 5 comments

#1071 - HTTP PROXY Support NTCredentials

Issue - State: open - Opened by dfercode about 1 year ago - 3 comments
Labels: blocked

#1070 - Failling to write to BigQuery using AVRO intermediateFormat

Issue - State: closed - Opened by heyashy about 1 year ago - 2 comments

#1069 - Support TimestampNTZ datatype in spark 3.4

Pull Request - State: closed - Opened by isha97 about 1 year ago - 8 comments

#1068 - Dataproc with Cloud Data Fusion is not able to read BigQuery Table

Issue - State: closed - Opened by Ajinkya1788 about 1 year ago - 3 comments
Labels: waiting for information

#1067 - sending read metrics to spark-metrics-listener

Pull Request - State: closed - Opened by suryasoma about 1 year ago

#1066 - Issue #453: fix comment handling in query

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 4 comments

#1065 - Add Integer based partition Support

Issue - State: closed - Opened by amandaolens about 1 year ago - 3 comments

#1064 - Not able to partition based on string column.

Issue - State: closed - Opened by amandaolens about 1 year ago - 1 comment

#1063 - Bump org.apache.commons:commons-compress from 1.23.0 to 1.24.0 in /spark-bigquery-parent

Pull Request - State: closed - Opened by dependabot[bot] about 1 year ago - 2 comments
Labels: dependencies

#1061 - Handle NPE case when reading BQ table with NUMERIC fields

Pull Request - State: closed - Opened by hayssams about 1 year ago - 7 comments

#1060 - getPrecision and getScale may return null and should be considered optional

Issue - State: closed - Opened by hayssams about 1 year ago - 3 comments

#1059 - Forcing constant POM structure using the tidy plugin

Pull Request - State: open - Opened by davidrabinowitz about 1 year ago - 5 comments

#1058 - View names will appear in query plan instead of the materialized table

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 6 comments

#1057 - Enable async writes for greater throughput.

Pull Request - State: closed - Opened by agrawal-siddharth about 1 year ago - 15 comments

#1055 - async appendRows response validation

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 2 comments

#1054 - Format metrics; add (min, med, max) for timing metrics

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 2 comments

#1053 - fix logging

Pull Request - State: closed - Opened by vishalkarve15 about 1 year ago - 1 comment

#1052 - Dependency versions update

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago - 2 comments

#1049 - adding ReadRows logging, should not be merged!

Pull Request - State: closed - Opened by davidrabinowitz about 1 year ago

#1048 - Fixing the readme file for DateTime support

Pull Request - State: closed - Opened by suryasoma about 1 year ago

#1047 - DATETIME parsing in PySpark

Issue - State: closed - Opened by satybald about 1 year ago

#1046 - Add a way to disable map type support.

Issue - State: closed - Opened by GrzegorzSmardzewskiAllegro about 1 year ago - 1 comment

#1045 - Try to clarify the pushAllFilters setting

Issue - State: closed - Opened by lchen4snap about 1 year ago - 2 comments

#1044 - Support setting policy tags using Spark column's metadata

Issue - State: closed - Opened by khaledh about 1 year ago - 1 comment

#1043 - Indirect write drops policy tags

Issue - State: closed - Opened by khaledh about 1 year ago - 2 comments
Labels: enhancement

#1042 - how to use 'datetimeZoneId' config in Spark Bigquery Connector

Issue - State: closed - Opened by psonilloyds over 1 year ago - 1 comment

#1041 - Code simplification

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 2 comments

#1040 - Spark observable metrics not working when writing to BigQuery tables

Issue - State: open - Opened by ylashin over 1 year ago - 3 comments
Labels: enhancement

#1039 - CVE-2023-34462: Upgrading netty

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 2 comments

#1038 - add toString to DirectBigQueryRelation

Pull Request - State: closed - Opened by idc101 over 1 year ago - 3 comments

#1037 - Detect presence of policy tags in destination table.

Pull Request - State: closed - Opened by agrawal-siddharth over 1 year ago - 1 comment

#1035 - Updated CHANGES file

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago

#1034 - Writer retry policy missing correct parameters

Issue - State: closed - Opened by mina-asham over 1 year ago

#1033 - Fixing numeric to decimal conversion

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 8 comments

#1032 - Issue #1028: Fixing PolicyTags removal on overwrite

Pull Request - State: closed - Opened by suryasoma over 1 year ago - 4 comments

#1031 - Numeric -> decimal(38,9) -> BigNumeric issue with v0.31.0

Issue - State: closed - Opened by idc101 over 1 year ago - 4 comments

#1030 - fix(writer): Initialise retry settings with a delay between retires

Pull Request - State: closed - Opened by mina-asham over 1 year ago - 2 comments

#1029 - Issues when using the connector with Databricks

Issue - State: closed - Opened by viniciuspnu over 1 year ago - 6 comments

#1028 - Policy tags removed when using the latest version (0.32.0)

Issue - State: closed - Opened by khaledh over 1 year ago - 9 comments

#1025 - Handle Java 8 types for dates and timestamps when compiling filters

Pull Request - State: closed - Opened by tom-s-powell over 1 year ago - 7 comments

#1024 - Faster integration tests (WIP)

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 1 comment

#1022 - Issue #1021: Logging partition write exceptions in driver

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 3 comments

#1020 - Fixed the CHANGES file

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago

#1019 - fixing the spark 3.4 connector dependency

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago - 1 comment

#1017 - Issue #144: allow writing Spark String to BQ TIME type

Pull Request - State: closed - Opened by vishalkarve15 over 1 year ago - 9 comments

#1016 - Applied spotless to the README

Pull Request - State: closed - Opened by davidrabinowitz over 1 year ago

#1013 - Issue #867: Support writing with RangePartitioning

Pull Request - State: closed - Opened by vishalkarve15 over 1 year ago - 13 comments