MrPowers/spark-daria issues and pull requests

#154 - Create release process that automatically attaches JAR file to release

Issue - State: open - Opened by MrPowers almost 2 years ago

#153 - CustomTransform RequiredColumns & AddedColumns are case sensitive

Issue - State: open - Opened by labbedaine almost 2 years ago - 1 comment

#152 - DariaWriters.writeSingleFile() needs to accept options parameter

Issue - State: open - Opened by rangareddy about 2 years ago - 1 comment

#151 - Create a better release process

Issue - State: open - Opened by MrPowers over 2 years ago - 1 comment

#151 - Create a better release process

Issue - State: open - Opened by MrPowers over 2 years ago - 1 comment

#150 - writeSingleFile doesn't create folders in s3

Issue - State: open - Opened by jeremy-giaco over 2 years ago - 1 comment

#150 - writeSingleFile doesn't create folders in s3

Issue - State: open - Opened by jeremy-giaco over 2 years ago - 1 comment

#149 - Question

Issue - State: closed - Opened by diogomrks over 3 years ago - 2 comments

#148 - NotNull assertion expression

Issue - State: closed - Opened by skestle over 3 years ago - 4 comments

#148 - NotNull assertion expression

Issue - State: closed - Opened by skestle over 3 years ago - 4 comments

#148 - NotNull assertion expression

Issue - State: closed - Opened by skestle over 3 years ago - 4 comments

#147 - Rename library to spark-helga

Issue - State: closed - Opened by 8402sea over 3 years ago

#147 - Rename library to spark-helga

Issue - State: closed - Opened by 8402sea over 3 years ago

#146 - IntelliJ: Cannot resolve symbol transformations

Issue - State: open - Opened by labbedaine over 3 years ago - 3 comments

#145 - Lenient schema validation

Pull Request - State: open - Opened by skestle over 3 years ago - 1 comment

#145 - Lenient schema validation

Pull Request - State: open - Opened by skestle over 3 years ago - 1 comment

#144 - Ensured that schema validation matches nested structures that are in different order

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#144 - Ensured that schema validation matches nested structures that are in different order

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#143 - Support scala 2.13 (to enable full spark 3.2.0 support)

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#143 - Support scala 2.13 (to enable full spark 3.2.0 support)

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#142 - Format sources and add formatting check to CI

Pull Request - State: closed - Opened by cbcoutinho over 3 years ago

#142 - Format sources and add formatting check to CI

Pull Request - State: closed - Opened by cbcoutinho over 3 years ago

#141 - Add methods to modify column names to camelCase, snakeCase and upperCase

Pull Request - State: closed - Opened by santhoshdesikachari over 3 years ago - 1 comment

#141 - Add methods to modify column names to camelCase, snakeCase and upperCase

Pull Request - State: closed - Opened by santhoshdesikachari over 3 years ago - 1 comment

#140 - ParquetCompactor can only work for parquet written by Spark

Issue - State: open - Opened by yuxh over 3 years ago

#140 - ParquetCompactor can only work for parquet written by Spark

Issue - State: open - Opened by yuxh over 3 years ago

#139 - .Net for Spark

Issue - State: closed - Opened by dbeavon over 3 years ago - 3 comments

#139 - .Net for Spark

Issue - State: closed - Opened by dbeavon over 3 years ago - 3 comments

#138 - Print createDataFrame syntax for a DataFrame

Pull Request - State: closed - Opened by MrPowers over 3 years ago

#137 - Add schema safe Parquet writer

Pull Request - State: closed - Opened by MrPowers over 3 years ago - 1 comment

#137 - Add schema safe Parquet writer

Pull Request - State: closed - Opened by MrPowers over 3 years ago - 1 comment

#137 - Add schema safe Parquet writer

Pull Request - State: closed - Opened by MrPowers over 3 years ago - 1 comment

#135 - Bump to Spark 3 and remove deprecated code

Pull Request - State: closed - Opened by MrPowers over 3 years ago

#135 - Bump to Spark 3 and remove deprecated code

Pull Request - State: closed - Opened by MrPowers over 3 years ago

#135 - Bump to Spark 3 and remove deprecated code

Pull Request - State: closed - Opened by MrPowers over 3 years ago

#134 - Rename the primary branch to be "main"

Issue - State: closed - Opened by MrPowers over 3 years ago - 1 comment

#133 - Add new functions: greatest and least

Issue - State: open - Opened by igreenfield almost 4 years ago

#133 - Add new functions: greatest and least

Issue - State: open - Opened by igreenfield almost 4 years ago

#132 - Misleading error message in assertSmallDatarameEquality

Issue - State: open - Opened by fibona44i about 4 years ago

#132 - Misleading error message in assertSmallDatarameEquality

Issue - State: open - Opened by fibona44i about 4 years ago

#132 - Misleading error message in assertSmallDatarameEquality

Issue - State: open - Opened by fibona44i about 4 years ago

#131 - WIP: adding safeGetXXX functions

Pull Request - State: closed - Opened by jesinity about 4 years ago - 3 comments

#130 - Add new process to publish JAR files

Pull Request - State: closed - Opened by MrPowers about 4 years ago

#129 - New release soon?

Issue - State: closed - Opened by colindean about 4 years ago - 2 comments

#129 - New release soon?

Issue - State: closed - Opened by colindean about 4 years ago - 2 comments

#129 - New release soon?

Issue - State: closed - Opened by colindean about 4 years ago - 2 comments

#128 - Update sbt-scalafmt plugin version and format source

Pull Request - State: closed - Opened by cbcoutinho over 4 years ago - 1 comment

#128 - Update sbt-scalafmt plugin version and format source

Pull Request - State: closed - Opened by cbcoutinho over 4 years ago - 1 comment

#128 - Update sbt-scalafmt plugin version and format source

Pull Request - State: closed - Opened by cbcoutinho over 4 years ago - 1 comment

#127 - Does withColumnRenamed have a hidden cost similar to the hidden cost of withColumn

Issue - State: closed - Opened by MrPowers over 4 years ago - 1 comment

#127 - Does withColumnRenamed have a hidden cost similar to the hidden cost of withColumn

Issue - State: closed - Opened by MrPowers over 4 years ago - 1 comment

#126 - Add extract, load, transform generic code

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#125 - add helpers for writing out data in a single file with a specific name

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#125 - add helpers for writing out data in a single file with a specific name

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#125 - add helpers for writing out data in a single file with a specific name

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#124 - Excel epoch converter col functions

Pull Request - State: closed - Opened by cmftall over 4 years ago - 5 comments

#124 - Excel epoch converter col functions

Pull Request - State: closed - Opened by cmftall over 4 years ago - 5 comments

#124 - Excel epoch converter col functions

Pull Request - State: closed - Opened by cmftall over 4 years ago - 5 comments

#123 - Wanted to understand how can i use your this repo

Issue - State: closed - Opened by pankajpkh24 over 4 years ago - 1 comment

#123 - Wanted to understand how can i use your this repo

Issue - State: closed - Opened by pankajpkh24 over 4 years ago - 1 comment

#123 - Wanted to understand how can i use your this repo

Issue - State: closed - Opened by pankajpkh24 over 4 years ago - 1 comment

#122 - ParquetCompactor should accept SparkSession as a dependency

Issue - State: open - Opened by MrPowers over 4 years ago

#122 - ParquetCompactor should accept SparkSession as a dependency

Issue - State: open - Opened by MrPowers over 4 years ago

#122 - ParquetCompactor should accept SparkSession as a dependency

Issue - State: open - Opened by MrPowers over 4 years ago

#121 - Prepping for Spark 3

Issue - State: closed - Opened by MrPowers over 4 years ago - 12 comments

#120 - Add an evalString Column extension so users don't need to chain so ma…

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#119 - Cannot deploy project - Spark Packages is broken

Issue - State: closed - Opened by MrPowers over 4 years ago - 6 comments

#118 - Make the code to modify the column names generic

Pull Request - State: closed - Opened by MrPowers over 4 years ago - 3 comments

#117 - how can I get src download

Issue - State: closed - Opened by yuxh over 4 years ago - 2 comments

#117 - how can I get src download

Issue - State: closed - Opened by yuxh over 4 years ago - 2 comments

#116 - Add a transformation to convert all the columns of a DataFrame to Par…

Pull Request - State: closed - Opened by MrPowers over 4 years ago - 5 comments

#116 - Add a transformation to convert all the columns of a DataFrame to Par…

Pull Request - State: closed - Opened by MrPowers over 4 years ago - 5 comments

#115 - Idea: add transformation for converting column names to parquet compatible ones

Issue - State: closed - Opened by eclosson over 4 years ago - 3 comments

#115 - Idea: add transformation for converting column names to parquet compatible ones

Issue - State: closed - Opened by eclosson over 4 years ago - 3 comments

#115 - Idea: add transformation for converting column names to parquet compatible ones

Issue - State: closed - Opened by eclosson over 4 years ago - 3 comments

#114 - Add function to structure flat dataframe and drop nested column

Pull Request - State: closed - Opened by gorros over 4 years ago - 2 comments

#113 - Droping nested columns

Issue - State: closed - Opened by gorros over 4 years ago - 3 comments

#113 - Droping nested columns

Issue - State: closed - Opened by gorros over 4 years ago - 3 comments

#112 - ParquetCompactor is not deleting old files and the input_file_name_parts directory on S3

Issue - State: closed - Opened by kstrempel almost 5 years ago

#112 - ParquetCompactor is not deleting old files and the input_file_name_parts directory on S3

Issue - State: closed - Opened by kstrempel almost 5 years ago

#112 - ParquetCompactor is not deleting old files and the input_file_name_parts directory on S3

Issue - State: closed - Opened by kstrempel almost 5 years ago

#111 - does ParquetCompactor work with S3?

Issue - State: closed - Opened by cmollis almost 5 years ago - 1 comment

#111 - does ParquetCompactor work with S3?

Issue - State: closed - Opened by cmollis almost 5 years ago - 1 comment

#110 - Fix flattening of deeply nested dataframes.

Pull Request - State: closed - Opened by gorros almost 5 years ago - 1 comment

#110 - Fix flattening of deeply nested dataframes.

Pull Request - State: closed - Opened by gorros almost 5 years ago - 1 comment

#110 - Fix flattening of deeply nested dataframes.

Pull Request - State: closed - Opened by gorros almost 5 years ago - 1 comment

#109 - Three level nested structure flattening fails

Issue - State: closed - Opened by gorros almost 5 years ago

#109 - Three level nested structure flattening fails

Issue - State: closed - Opened by gorros almost 5 years ago

#109 - Three level nested structure flattening fails

Issue - State: closed - Opened by gorros almost 5 years ago

#108 - Add project to scala-steward to update dependencies

Issue - State: open - Opened by manuzhang almost 5 years ago

#108 - Add project to scala-steward to update dependencies

Issue - State: open - Opened by manuzhang almost 5 years ago

#107 - Functions to extract by regular expresssion groups

Pull Request - State: closed - Opened by MrPowers almost 5 years ago

#107 - Functions to extract by regular expresssion groups

Pull Request - State: closed - Opened by MrPowers almost 5 years ago

#106 - Java, JDK and Hadoop versions for CI

Issue - State: closed - Opened by MrPowers about 5 years ago - 2 comments

#106 - Java, JDK and Hadoop versions for CI

Issue - State: closed - Opened by MrPowers about 5 years ago - 2 comments

#106 - Java, JDK and Hadoop versions for CI

Issue - State: closed - Opened by MrPowers about 5 years ago - 2 comments

#105 - Revert "Add transform higher order function (#94)"

Pull Request - State: closed - Opened by nvander1 about 5 years ago - 1 comment

#105 - Revert "Add transform higher order function (#94)"

Pull Request - State: closed - Opened by nvander1 about 5 years ago - 1 comment

#104 - Strange FileNotFoundException when running printAthenaCreateTable

Issue - State: closed - Opened by nchammas about 5 years ago - 5 comments

#104 - Strange FileNotFoundException when running printAthenaCreateTable

Issue - State: closed - Opened by nchammas about 5 years ago - 5 comments

GitHub / MrPowers/spark-daria issues and pull requests