bxparks/bigquery-schema-generator issues and pull requests

#99 - merge 1.6.1 into master

Pull Request - State: closed - Opened by bxparks about 1 year ago

#98 - [FEATURE] Starting with an existing schema, exclude rows that do not match the existing schema

Issue - State: closed - Opened by yusuffgur about 1 year ago - 4 comments

#97 - add configurable csv.field_size_limit in SchemaGenerator

Issue - State: closed - Opened by mzapukhlyak over 1 year ago - 5 comments

#95 - Is there a way to supress the logs from bigquery schema generator?

Issue - State: closed - Opened by kabilan-dt over 1 year ago

#94 - mode conflation in nullable nested, repeated records

Issue - State: closed - Opened by daniel-bartley over 1 year ago - 2 comments

#93 - Bump version to 1.6.0; same as 1.5.2

Pull Request - State: closed - Opened by bxparks almost 2 years ago

#92 - merge 1.5.2 into master

Pull Request - State: closed - Opened by bxparks almost 2 years ago

#90 - schema inference involving nulls and arrays produces inconsistent results

Issue - State: closed - Opened by dannynoar almost 2 years ago - 4 comments

#89 - Column name must start with a letter or underscore

Issue - State: closed - Opened by somanishivam almost 2 years ago - 2 comments

#88 - merge 1.5.1 into master

Pull Request - State: closed - Opened by bxparks about 2 years ago

#86 - AttributeError: 'NoneType' object has no attribute 'lower'

Issue - State: closed - Opened by lekesh over 2 years ago - 5 comments

#85 - add BQ NUMERIC type

Pull Request - State: closed - Opened by henriqueribeiro over 2 years ago - 1 comment

#83 - sanitize_name and field name starting by number

Issue - State: closed - Opened by JaSei almost 3 years ago - 1 comment

#80 - Fails to generate schema on nested json

Issue - State: closed - Opened by tpcgold almost 3 years ago

#79 - Python Code Examples 404

Issue - State: closed - Opened by stevejlock about 3 years ago - 1 comment

#76 - merge v1.5 into master

Pull Request - State: closed - Opened by bxparks about 3 years ago

#75 - Add option to preserve the original ordering of columns

Pull Request - State: closed - Opened by kdeggelman about 3 years ago - 12 comments

#74 - Add csv dialect matrix

Pull Request - State: closed - Opened by falderin over 3 years ago

#72 - merge v1.4.1 into master

Pull Request - State: closed - Opened by bxparks over 3 years ago

#71 - Cannot flatten schema due to schema map being a tuple[OrderedDict, list]

Issue - State: closed - Opened by khorabi55 over 3 years ago - 5 comments

#70 - Add dataclass support

Pull Request - State: closed - Opened by 8W9aG over 3 years ago - 4 comments

#69 - Unsupported array element type: array

Issue - State: closed - Opened by sbarkar almost 4 years ago - 3 comments

#68 - apply quoted_values_are_strings to timetstamps?

Issue - State: closed - Opened by AlexFragotsis almost 4 years ago - 5 comments

#67 - CSV Delimiter Option

Issue - State: closed - Opened by XenoLight almost 4 years ago - 6 comments

#66 - Feature/kirby schema

Pull Request - State: closed - Opened by SofieBn almost 4 years ago

#65 - merge v1.4 into master

Pull Request - State: closed - Opened by bxparks about 4 years ago

#64 - [FEATURE] Starting with an existing schema, epoch time cannot mismatched type TIMESTAMP --> INTEGER

Issue - State: open - Opened by abroglesc about 4 years ago - 6 comments

#63 - Add support and testing for 'dict' in SchemaGenerator (fixes #58)

Pull Request - State: closed - Opened by ZiggerZZ about 4 years ago

#62 - merge 1.3 into master

Pull Request - State: closed - Opened by bxparks about 4 years ago

#61 - Add support for existing BigQuery Schema with a single squashed commit (replace #57)

Pull Request - State: closed - Opened by abroglesc about 4 years ago - 4 comments

#60 - Schema augmentation function

Pull Request - State: closed - Opened by alexivkin about 4 years ago - 5 comments

#59 - Allow sections in test DataReader to appear in any order

Issue - State: open - Opened by abroglesc about 4 years ago

#58 - Schema generation from a list

Issue - State: closed - Opened by ZiggerZZ about 4 years ago - 3 comments

#57 - Add support for existing BigQuery Schema (replace #40)

Pull Request - State: closed - Opened by abroglesc about 4 years ago - 15 comments

#56 - [WIP] Empty nested records with keep_nulls=False produce a record with no fields

Pull Request - State: closed - Opened by abroglesc about 4 years ago - 3 comments

#55 - [BUG] - empty nested records with keep_nulls=False produce a record with no fields

Issue - State: closed - Opened by abroglesc about 4 years ago - 6 comments

#54 - merge 1.2 into master

Pull Request - State: closed - Opened by bxparks over 4 years ago

#53 - Adding ability to log full field path in error messages instead of just the most nested key

Pull Request - State: closed - Opened by abroglesc over 4 years ago - 3 comments

#52 - [FEATURE] When a nested field has mismatched type print the full path to that nested field

Issue - State: closed - Opened by abroglesc over 4 years ago - 5 comments

#51 - Loading GCP stackdriver logs into BQ

Issue - State: closed - Opened by coffeecoco over 4 years ago - 3 comments

#50 - merge v1.1 into master

Pull Request - State: closed - Opened by bxparks over 4 years ago

#49 - Skip bad records instead of throwing an exception?

Issue - State: closed - Opened by VictorLeP over 4 years ago - 8 comments

#48 - Ignoring non-RECORD field with mismatched mode: - error

Issue - State: closed - Opened by IAmBotmaker over 4 years ago - 2 comments

#47 - Allow option to pass in iterable of dictionaries when used as a library

Issue - State: closed - Opened by abroglesc almost 5 years ago - 3 comments

#46 - Dates which are not in ISO format...

Issue - State: closed - Opened by rajib76 almost 5 years ago - 8 comments

#45 - merge v1.0 into master

Pull Request - State: closed - Opened by bxparks almost 5 years ago

#44 - fix recursive sanitization of field names in records of type RECORD

Pull Request - State: closed - Opened by riccardomc almost 5 years ago

#43 - recursive name sanitization of records of type RECORD fails

Issue - State: closed - Opened by riccardomc almost 5 years ago - 1 comment

#42 - Quick note to say thanks!

Issue - State: closed - Opened by max-sixty almost 5 years ago - 1 comment

#41 - getting error after running the generate-schema

Issue - State: closed - Opened by snowlover173 almost 5 years ago - 1 comment

#40 - Add support for starting from exising BQ schema

Pull Request - State: closed - Opened by bozzzzo almost 5 years ago - 6 comments

#39 - Can the schema generation tool suppress case insensitive duplicates that are not accepted by bigquery?

Issue - State: closed - Opened by deepakmalpote over 5 years ago - 2 comments

#38 - Sudo pip install is discouraged

Issue - State: closed - Opened by alexwennerberg over 5 years ago - 1 comment

#37 - infer_mode still returns "REQUIRED" for json file

Issue - State: closed - Opened by rconnol over 5 years ago - 2 comments

#36 - When creating a load job programmatically, load_job.schema has to be a list of bigquery.SchemaField objects

Issue - State: closed - Opened by rconnol over 5 years ago - 2 comments

#35 - 0.5.1 - add '--sanitize_names' flag

Pull Request - State: closed - Opened by bxparks over 5 years ago

#34 - Added handling of conversion of names

Pull Request - State: closed - Opened by jonwarghed over 5 years ago - 3 comments

#33 - Issue with invalid csv column names

Issue - State: closed - Opened by jonwarghed over 5 years ago

#32 - 0.5 - remove fields with unsolvable errors

Pull Request - State: closed - Opened by bxparks over 5 years ago

#31 - Type Inferrence in inconsistent lists of dictionaries

Issue - State: closed - Opened by georgejerzy over 5 years ago - 7 comments

#30 - new parameters for run method to use the object inside a own script

Pull Request - State: closed - Opened by StefanoGITA over 5 years ago - 7 comments

#29 - 0.4 - Support CSV files

Pull Request - State: closed - Opened by bxparks almost 6 years ago

#28 - Infer 'REQUIRED' mode with a flag for consistently filled in values

Pull Request - State: closed - Opened by korotkevics almost 6 years ago - 6 comments

#27 - Add support for CSV files with header in first row

Pull Request - State: closed - Opened by korotkevics almost 6 years ago

#26 - Add support for CSV files with header in first row

Pull Request - State: closed - Opened by bxparks almost 6 years ago - 13 comments

#25 - Add support of CSV format

Pull Request - State: closed - Opened by korotkevics almost 6 years ago - 4 comments

#24 - 0.3.2 - add flag to force quoted values to be inferred as strings

Pull Request - State: closed - Opened by bxparks almost 6 years ago

#23 - added --no_quoted_integer arg

Pull Request - State: closed - Opened by de-code almost 6 years ago

#22 - Make quoted integer detection optional

Issue - State: closed - Opened by de-code almost 6 years ago - 5 comments

#21 - support sending an existing schema to deduce_schema

Issue - State: closed - Opened by lior-lemonade almost 6 years ago - 2 comments

#20 - 0.3.1 - support integers that overflow 64 bits; support 'UTC' suffix

Pull Request - State: closed - Opened by bxparks about 6 years ago

#19 - Support for "UTC" suffix in TIMESTAMP data

Issue - State: closed - Opened by rsmorris123 about 6 years ago - 1 comment

#18 - Integers exceeding the bigquery integer limit are still converted to integer in the schema

Issue - State: closed - Opened by alvinburgos about 6 years ago - 2 comments

#17 - 0.3: support quoted values of BOOLEAN, INTEGER and FLOAT types

Pull Request - State: closed - Opened by bxparks about 6 years ago

#16 - Fix negative number support in Q REs and adds unit tests

Pull Request - State: closed - Opened by jtschichold about 6 years ago - 1 comment

#15 - Support for quoted types, pythonic script generation, strict DATE regex

Pull Request - State: closed - Opened by jtschichold about 6 years ago - 5 comments

#14 - error with white spaces & other wrong characters in column names

Issue - State: closed - Opened by iuiu34 over 6 years ago - 6 comments

#13 - support timezone without a colon (:) character

Issue - State: open - Opened by bxparks over 6 years ago

#12 - 0.2.1 - add benchmarks using anonymized data

Pull Request - State: closed - Opened by bxparks over 6 years ago