Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / mrpowers-io/spark-daria issues and pull requests

#171 - support flatten array

Pull Request - State: open - Opened by zeotuan 18 days ago

#169 - Run CI only on project affected by changes

Pull Request - State: open - Opened by zeotuan 3 months ago

#168 - flattenSchema: Support flattening map and array type

Issue - State: open - Opened by zeotuan 3 months ago

#167 - SBT project changes

Pull Request - State: closed - Opened by alfonsorr 4 months ago - 1 comment

#166 - Rand uniform/normal

Pull Request - State: closed - Opened by zeotuan 4 months ago

#165 - support rand_gamma on spark 3.4+

Pull Request - State: closed - Opened by zeotuan 4 months ago - 2 comments

#164 - Updated SBT

Pull Request - State: closed - Opened by alfonsorr 4 months ago - 1 comment

#163 - Update sbt version

Issue - State: open - Opened by alfonsorr 4 months ago

#162 - Add sortColumnsBy DataFraneExt

Pull Request - State: closed - Opened by zeotuan 4 months ago - 1 comment

#161 - Output create table from DataFrame

Issue - State: open - Opened by MrPowers 4 months ago

#160 - run test on pull request.

Pull Request - State: closed - Opened by zeotuan 4 months ago - 1 comment

#159 - Implement arrayConcat using aggregator

Pull Request - State: closed - Opened by zeotuan 4 months ago

#158 - Update CI

Issue - State: open - Opened by zeotuan 4 months ago

#157 - [Feature] Refactor ArrayConcat to use Aggregator

Issue - State: closed - Opened by zeotuan 4 months ago

#156 - Add randLaplace and native randGamma

Pull Request - State: closed - Opened by zeotuan 4 months ago

#153 - CustomTransform RequiredColumns & AddedColumns are case sensitive

Issue - State: open - Opened by labbedaine about 2 years ago - 1 comment

#152 - DariaWriters.writeSingleFile() needs to accept options parameter

Issue - State: open - Opened by rangareddy over 2 years ago - 1 comment

#151 - Create a better release process

Issue - State: open - Opened by MrPowers over 2 years ago - 1 comment

#150 - writeSingleFile doesn't create folders in s3

Issue - State: open - Opened by jeremy-giaco almost 3 years ago - 1 comment

#149 - Question

Issue - State: closed - Opened by diogomrks over 3 years ago - 2 comments

#148 - NotNull assertion expression

Issue - State: closed - Opened by skestle over 3 years ago - 4 comments

#147 - Rename library to spark-helga

Issue - State: closed - Opened by 8402sea over 3 years ago

#146 - IntelliJ: Cannot resolve symbol transformations

Issue - State: open - Opened by labbedaine over 3 years ago - 3 comments

#145 - Lenient schema validation

Pull Request - State: open - Opened by skestle over 3 years ago - 1 comment

#144 - Ensured that schema validation matches nested structures that are in different order

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#143 - Support scala 2.13 (to enable full spark 3.2.0 support)

Pull Request - State: closed - Opened by skestle over 3 years ago - 5 comments

#142 - Format sources and add formatting check to CI

Pull Request - State: closed - Opened by cbcoutinho almost 4 years ago

#141 - Add methods to modify column names to camelCase, snakeCase and upperCase

Pull Request - State: closed - Opened by santhoshdesikachari almost 4 years ago - 1 comment

#140 - ParquetCompactor can only work for parquet written by Spark

Issue - State: open - Opened by yuxh almost 4 years ago

#139 - .Net for Spark

Issue - State: closed - Opened by dbeavon almost 4 years ago - 3 comments

#138 - Print createDataFrame syntax for a DataFrame

Pull Request - State: closed - Opened by MrPowers almost 4 years ago

#137 - Add schema safe Parquet writer

Pull Request - State: closed - Opened by MrPowers almost 4 years ago - 1 comment

#135 - Bump to Spark 3 and remove deprecated code

Pull Request - State: closed - Opened by MrPowers almost 4 years ago

#134 - Rename the primary branch to be "main"

Issue - State: closed - Opened by MrPowers almost 4 years ago - 1 comment

#133 - Add new functions: greatest and least

Issue - State: open - Opened by igreenfield almost 4 years ago

#132 - Misleading error message in assertSmallDatarameEquality

Issue - State: open - Opened by fibona44i about 4 years ago

#131 - WIP: adding safeGetXXX functions

Pull Request - State: closed - Opened by jesinity over 4 years ago - 3 comments

#130 - Add new process to publish JAR files

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#129 - New release soon?

Issue - State: closed - Opened by colindean over 4 years ago - 2 comments

#128 - Update sbt-scalafmt plugin version and format source

Pull Request - State: closed - Opened by cbcoutinho over 4 years ago - 1 comment

#126 - Add extract, load, transform generic code

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#125 - add helpers for writing out data in a single file with a specific name

Pull Request - State: closed - Opened by MrPowers over 4 years ago

#124 - Excel epoch converter col functions

Pull Request - State: closed - Opened by cmftall over 4 years ago - 5 comments

#123 - Wanted to understand how can i use your this repo

Issue - State: closed - Opened by pankajpkh24 over 4 years ago - 1 comment

#122 - ParquetCompactor should accept SparkSession as a dependency

Issue - State: open - Opened by MrPowers almost 5 years ago

#121 - Prepping for Spark 3

Issue - State: closed - Opened by MrPowers almost 5 years ago - 12 comments

#120 - Add an evalString Column extension so users don't need to chain so ma…

Pull Request - State: closed - Opened by MrPowers almost 5 years ago

#119 - Cannot deploy project - Spark Packages is broken

Issue - State: closed - Opened by MrPowers almost 5 years ago - 6 comments

#118 - Make the code to modify the column names generic

Pull Request - State: closed - Opened by MrPowers almost 5 years ago - 3 comments

#117 - how can I get src download

Issue - State: closed - Opened by yuxh almost 5 years ago - 2 comments

#116 - Add a transformation to convert all the columns of a DataFrame to Par…

Pull Request - State: closed - Opened by MrPowers almost 5 years ago - 5 comments

#115 - Idea: add transformation for converting column names to parquet compatible ones

Issue - State: closed - Opened by eclosson almost 5 years ago - 3 comments

#114 - Add function to structure flat dataframe and drop nested column

Pull Request - State: closed - Opened by gorros almost 5 years ago - 2 comments

#113 - Droping nested columns

Issue - State: closed - Opened by gorros almost 5 years ago - 3 comments

#111 - does ParquetCompactor work with S3?

Issue - State: closed - Opened by cmollis about 5 years ago - 1 comment

#110 - Fix flattening of deeply nested dataframes.

Pull Request - State: closed - Opened by gorros about 5 years ago - 1 comment

#109 - Three level nested structure flattening fails

Issue - State: closed - Opened by gorros about 5 years ago

#108 - Add project to scala-steward to update dependencies

Issue - State: open - Opened by manuzhang about 5 years ago

#107 - Functions to extract by regular expresssion groups

Pull Request - State: closed - Opened by MrPowers about 5 years ago

#106 - Java, JDK and Hadoop versions for CI

Issue - State: closed - Opened by MrPowers over 5 years ago - 2 comments

#105 - Revert "Add transform higher order function (#94)"

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 1 comment

#104 - Strange FileNotFoundException when running printAthenaCreateTable

Issue - State: closed - Opened by nchammas over 5 years ago - 5 comments

#103 - Native implementation of regexp_extract_all

Pull Request - State: closed - Opened by MrPowers over 5 years ago - 1 comment

#102 - Revert "Higher order functions patch 1: transform"

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 1 comment

#101 - Deeply nested package structure

Issue - State: open - Opened by MrPowers over 5 years ago - 1 comment

#100 - Add a <==> operator that returns false if both columns are null

Pull Request - State: closed - Opened by MrPowers over 5 years ago - 6 comments

#99 - Run tests for different versions on travis

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 1 comment

#98 - Higher order functions patch 5: zip_with

Pull Request - State: closed - Opened by nvander1 over 5 years ago

#97 - Higher order functions patch 4: aggregate

Pull Request - State: closed - Opened by nvander1 over 5 years ago

#96 - Higher order functions patch 3: filter

Pull Request - State: closed - Opened by nvander1 over 5 years ago

#95 - Higher order functions patch 2: exists

Pull Request - State: closed - Opened by nvander1 over 5 years ago

#94 - Higher order functions patch 1: transform

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 2 comments

#93 - Add withColumnCast to DataFrameExt

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 3 comments

#92 - WIP Add higher order functions

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 2 comments

#91 - Add compileError test to check creating a DataFrame with a list of st…

Pull Request - State: closed - Opened by manuzhang over 5 years ago - 2 comments

#90 - Enhancing query pushdown in Postgres...

Issue - State: closed - Opened by MrPowers over 5 years ago - 1 comment

#89 - Add initial mill configuration

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 3 comments

#88 - Make DariaValidator extends DataFrameValidator

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 2 comments

#87 - Add gitter badge to README

Pull Request - State: closed - Opened by nvander1 over 5 years ago - 2 comments

#86 - Add a gitter room ?

Issue - State: closed - Opened by manuzhang over 5 years ago - 1 comment

#85 - Add higher order functions to Scala API

Issue - State: closed - Opened by MrPowers over 5 years ago - 3 comments

#84 - Support extractFromJson with json path expression

Pull Request - State: closed - Opened by manuzhang over 5 years ago - 6 comments

#83 - Add sbt-scoverage

Pull Request - State: closed - Opened by MrPowers over 5 years ago - 2 comments

#82 - Possibly publish in the GitHub package registry

Issue - State: closed - Opened by MrPowers over 5 years ago - 2 comments

#81 - Add Product as upper type bound for asSchema

Pull Request - State: closed - Opened by manuzhang over 5 years ago - 7 comments

#80 - Add an array_sum function to sum all the numbers in an array

Pull Request - State: closed - Opened by MrPowers over 5 years ago - 8 comments

#79 - Add ArraySum UDAF

Pull Request - State: closed - Opened by manuzhang over 5 years ago - 7 comments

#78 - asSchema should have Product as upper type bound

Issue - State: closed - Opened by manuzhang over 5 years ago - 4 comments

#77 - duplicate repo entries in pom file

Issue - State: closed - Opened by igreenfield over 5 years ago - 3 comments

#76 - artifact name convention

Issue - State: closed - Opened by igreenfield over 5 years ago - 5 comments

#75 - Add test coverage badge to repo

Issue - State: closed - Opened by MrPowers over 5 years ago - 11 comments

#74 - Add junit4git

Issue - State: closed - Opened by MrPowers over 5 years ago

#73 - Should we add more validators?

Issue - State: closed - Opened by MrPowers over 5 years ago - 12 comments

#72 - Add schemaFor method to get StructType from Scala Type

Pull Request - State: closed - Opened by manuzhang almost 6 years ago - 5 comments

#71 - Add createEmptyDF to SparkSessionExt

Pull Request - State: closed - Opened by manuzhang almost 6 years ago - 1 comment

#70 - can I use it with pyspark too?

Issue - State: closed - Opened by mundra-aman almost 6 years ago - 3 comments