samelamin/spark-bigquery issues and pull requests

#85 - 404 not found: Job <job name> not found error

Issue - State: open - Opened by jasleenarora9 over 2 years ago

#84 - Conflict occurred creating export directory already exists

Issue - State: open - Opened by ashay10001 almost 4 years ago - 1 comment

#83 - Method saveAsBigQueryTable([class java.lang.String]) does not exist: Issue persists even after shading guava dependecies

Issue - State: open - Opened by dduran28 about 4 years ago - 4 comments

#82 - Fix #56: Exception when biQuerySelect Returns Zero Rows

Pull Request - State: closed - Opened by sujeet100 almost 5 years ago - 6 comments

#81 - writing to bigquery from dataproc

Issue - State: closed - Opened by mikerlt almost 5 years ago - 1 comment

#80 - Export FS must derive from GoogleHadoopFileSystemBase

Issue - State: closed - Opened by roots4 almost 5 years ago - 1 comment

#79 - saveAsBigQueryTable exception with StructType column

Issue - State: open - Opened by andreclaudino almost 5 years ago - 1 comment
Labels: bug

#78 - Allow more BigQuery zones

Pull Request - State: closed - Opened by hafizbadrie about 5 years ago

#77 - Big query export from GCP to AWS S3 using Spark

Issue - State: closed - Opened by ChitturiPadma about 5 years ago - 2 comments

#76 - Give content of JSON credentials instead of path to it

Issue - State: closed - Opened by leobenkel about 5 years ago - 2 comments

#75 - Struck with error py4j.protocol.Py4JJavaError: An error occurred while calling o39.saveAsBigQueryTable. : java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;Ljava/lang/Object;)

Issue - State: closed - Opened by kishore8714 about 5 years ago - 6 comments

#74 - Update to use spark 2 4 0

Pull Request - State: closed - Opened by samelamin over 5 years ago

#73 - Exception in thread "main" java.lang.NoSuchMethodError:

Issue - State: closed - Opened by badgujarsupriya over 5 years ago - 14 comments
Labels: bug

#72 - getting java.lang.NoSuchMethodError on saveAsBigQueryTable

Issue - State: closed - Opened by oleg-mir over 5 years ago - 1 comment

#71 - Utilize Bigquery Storage API

Issue - State: open - Opened by smith-m over 5 years ago - 2 comments
Labels: enhancement

#70 - DML query drop and create table takes time

Issue - State: closed - Opened by yogesh-0586 over 5 years ago - 3 comments

#69 - Error when changing zone to something other than EU/US

Issue - State: closed - Opened by ghost over 5 years ago - 3 comments

#68 - read table second time show error Conflict occurred creating export directory

Issue - State: open - Opened by yogesh-0586 over 5 years ago - 1 comment
Labels: bug

#67 - runDMLQuery on AWS Glue throws an exception because of Jersey libraries conflict

Issue - State: closed - Opened by cheptsov over 5 years ago - 1 comment

#66 - shade guava

Pull Request - State: closed - Opened by samelamin almost 6 years ago

#65 - build fix

Pull Request - State: closed - Opened by samelamin almost 6 years ago

#64 - Time ingestion hotfix

Pull Request - State: closed - Opened by samelamin almost 6 years ago

#63 - Write to bigquery using DataframeWriter

Issue - State: open - Opened by fbbergamo almost 6 years ago - 2 comments
Labels: enhancement

#62 - Missing end of block

Pull Request - State: closed - Opened by fbbergamo almost 6 years ago

#61 - java.lang.ClassCastException: java.lang.Long cannot be cast to java.sql.Timestamp

Issue - State: open - Opened by holamap almost 6 years ago - 1 comment
Labels: bug

#60 - Using spark-bigquery connector in AWS EMR Zeppelin

Issue - State: closed - Opened by Jeeva-Ganesan about 6 years ago - 4 comments

#59 - change float to double type

Pull Request - State: closed - Opened by smdmts about 6 years ago - 5 comments

#58 - [Proposal] add sbt-coursier

Pull Request - State: closed - Opened by smdmts about 6 years ago - 1 comment

#57 - class cast exception has occurs (Double cannot be cast to Float)

Issue - State: closed - Opened by smdmts about 6 years ago - 3 comments

#56 - Exception when biQuerySelect Returns Zero Rows

Issue - State: closed - Opened by ps-githinjose about 6 years ago - 1 comment
Labels: bug

#55 - Add time ingested partitioning

Pull Request - State: closed - Opened by samelamin over 6 years ago

#54 - PySpark: Method saveAsBigQueryTable does not exist

Issue - State: closed - Opened by mfoti over 6 years ago - 4 comments

#53 - Import Error with Databricks from a table with streaming

Issue - State: closed - Opened by yohannnyc over 6 years ago - 1 comment

#52 - Added support for load using spark sql datasource API

Pull Request - State: closed - Opened by phatak-dev over 6 years ago - 1 comment

#51 - upgrade to spark 2.2

Pull Request - State: closed - Opened by samelamin over 6 years ago

#50 - Problems with Guava version using spark 2.2

Issue - State: closed - Opened by lbadi over 6 years ago - 3 comments

#49 - Minimal working example

Issue - State: closed - Opened by gbordyugov over 6 years ago - 12 comments

#48 - Import Error with Databricks

Issue - State: closed - Opened by mayankshah891 over 6 years ago - 13 comments

#47 - Document PySpark example

Pull Request - State: closed - Opened by streadway over 6 years ago - 1 comment

#46 - Usage with RStudio's sparklyr

Issue - State: closed - Opened by martinstuder over 6 years ago - 4 comments

#45 - Json parsing failed when i was using the saveAsBigQueryTable

Issue - State: closed - Opened by Ayyappadas1 over 6 years ago - 5 comments

#44 - java.lang.ClassNotFoundException: java.lang.ProcessEnvironment$Variable

Issue - State: closed - Opened by 87sanchavan almost 7 years ago - 12 comments

#43 - Ability to use this on DataProc Google Platform

Issue - State: closed - Opened by darylerwin almost 7 years ago - 5 comments

#42 - update docs to reflect standard sql

Pull Request - State: closed - Opened by vijaykramesh almost 7 years ago

#41 - Pyspark complete code

Issue - State: closed - Opened by 87sanchavan almost 7 years ago - 1 comment

#40 - Add PySpark and DML query support

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#39 - Bug: Streaming Window does not write window.StartTime and window.endTime

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 1 comment

#38 - Bug: Null type not supported error when setting a null value to a DF column

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 2 comments

#37 - Feature Request: DML Operations - Update, Delete Support

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 1 comment

#36 - Add table decorators

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#35 - Gcs fix

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#34 - "Couldn't match type NullType"

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 1 comment

#33 - Custom partitioning of historic data using table decorators

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 5 comments
Labels: enhancement

#32 - implement the actual fix!

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#31 - fix for bq load timestamp

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#30 - ISSUE: bq_load_timestamp corrupted

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 2 comments

#29 - BQ Streaming Inserts

Issue - State: closed - Opened by kurtmaile almost 7 years ago - 2 comments

#28 - Fix watermarking

Pull Request - State: closed - Opened by samelamin almost 7 years ago

#27 - Structured Streaming - Quota Limits and Trigger Interval

Issue - State: closed - Opened by kurtmaile about 7 years ago - 2 comments

#26 - java.io.IOException: Not found: Uris gs

Issue - State: closed - Opened by kurtmaile about 7 years ago - 35 comments

#25 - Fix for https://github.com/samelamin/spark-bigquery/issues/23

Pull Request - State: closed - Opened by samelamin about 7 years ago - 1 comment

#24 - Structured Stremaing schema updates support timeline

Issue - State: closed - Opened by kurtmaile about 7 years ago - 1 comment

#23 - BQ Table Schema - Maintaining Original Case of Spark DF Schema

Issue - State: closed - Opened by kurtmaile about 7 years ago - 8 comments

#22 - Table Region not EU

Issue - State: closed - Opened by kurtmaile about 7 years ago - 3 comments

#21 - How the package writes data on BigQuery?

Issue - State: closed - Opened by lnicalo about 7 years ago - 1 comment

#20 - Spark 2.1 - Structured Streaming Watermarking Exception

Issue - State: closed - Opened by kurtmaile about 7 years ago - 28 comments

#19 - Don't clear the entire ENV when running EnvHacker

Pull Request - State: closed - Opened by vijaykramesh about 7 years ago - 4 comments

#18 - Databricks - GCP Key Missing in Multi-Node Cluster

Issue - State: closed - Opened by kurtmaile about 7 years ago - 3 comments

#17 - Feature Request: Spark MapType mapping to BQuery

Issue - State: closed - Opened by kurtmaile about 7 years ago - 2 comments

#16 - setBigQueryDatasetLocation break YARN mode

Issue - State: closed - Opened by vijaykramesh about 7 years ago - 5 comments

#15 - BQ Tables partitioned by time by default

Issue - State: closed - Opened by lnicalo about 7 years ago - 1 comment

#14 - write to transaction json

Pull Request - State: closed - Opened by samelamin about 7 years ago - 3 comments

#13 - Spark MapType conversion no supported?

Issue - State: closed - Opened by kurtmaile about 7 years ago - 5 comments

#12 - checkpointing when writing in BigQuery?

Issue - State: closed - Opened by lnicalo about 7 years ago - 3 comments

#11 - saveAsBigQueryTable: Schemas dont match?

Issue - State: closed - Opened by kurtmaile about 7 years ago - 4 comments