Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / smart-data-lake/smart-data-lake issues and pull requests

#942 - HadoopFileDataObject: use listFiles instead of globFiles

Pull Request - State: closed - Opened by zzeekk 5 days ago - 1 comment

#941 - Bump some library versions

Pull Request - State: closed - Opened by zzeekk 5 days ago - 1 comment

#940 - Rename DeduplicateAction as MergeAction

Issue - State: open - Opened by zzeekk 7 days ago
Labels: enhancement

#939 - Remove TickTockHiveTableDataObject

Issue - State: open - Opened by zzeekk 7 days ago
Labels: enhancement

#938 - python inline indentation

Issue - State: open - Opened by mand35 16 days ago
Labels: enhancement

#937 - #871 implement draft of generic column transformer

Pull Request - State: open - Opened by Geheiner 24 days ago - 3 comments

#936 - Make schema converter non-strict for decimal to factorial number conversion

Issue - State: open - Opened by zzeekk about 1 month ago
Labels: bug

#935 - Check SchemaUtil.deepPartialMatchDiffFields for structs nested in arrays

Issue - State: open - Opened by zzeekk about 1 month ago
Labels: bug

#934 - Compressed writing to Kafka

Issue - State: closed - Opened by AdiWehrli about 1 month ago - 6 comments

#933 - Databricks blog post review

Pull Request - State: closed - Opened by zzeekk about 1 month ago

#932 - UIBackend upload improvements

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#931 - UIBackend: implement description upload

Issue - State: open - Opened by zzeekk about 1 month ago
Labels: enhancement

#930 - Update ODataDataObject doc

Pull Request - State: closed - Opened by iliassoto about 1 month ago - 1 comment

#929 - Cleaning of ODataDataObject

Issue - State: closed - Opened by iliassoto about 1 month ago
Labels: technical-debt

#928 - Feature/databricks blogpost doc

Pull Request - State: closed - Opened by Geheiner about 1 month ago

#927 - Create Snowflake Iceberg Table

Issue - State: open - Opened by zzeekk about 1 month ago
Labels: enhancement

#926 - Cmd Line: add default value master=local[*]

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#925 - HistorizeAction should support Half-Open interval

Issue - State: closed - Opened by zzeekk about 1 month ago
Labels: enhancement

#924 - implement GenericDataFrame for DeduplicateAction and HistorizeAction

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 2 comments

#923 - Bad value for type BigDecimal : NaN in Postgres

Issue - State: open - Opened by ThierryGirod about 1 month ago
Labels: bug

#922 - Update commandLine.md (#887)

Pull Request - State: closed - Opened by zzeekk about 1 month ago

#921 - KafkaTopicDataObject: fix passing through tombstone messages (#915)

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 2 comments

#920 - make SparkSmartDataLakeBuilder master/deploy-mode optionally

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#919 - Fix SnowflakeTableDataObject Serializable problem

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#918 - implement Environment.throwExceptionOnSparkListenerError (#917)

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 2 comments

#917 - Make metric gathering optional

Issue - State: closed - Opened by pgruetter about 2 months ago - 1 comment
Labels: enhancement

#916 - Make Historize/DeduplicatAction generic

Issue - State: closed - Opened by zzeekk about 2 months ago - 1 comment
Labels: enhancement, technical-debt

#915 - Add filter to ignore invalid Kafka messages

Issue - State: closed - Opened by AdiWehrli about 2 months ago - 7 comments
Labels: enhancement

#914 - Release 2.7.2 retry

Pull Request - State: closed - Opened by zzeekk about 2 months ago

#913 - Update hoconSecrets.md

Pull Request - State: closed - Opened by kaelte about 2 months ago
Labels: bug

#912 - Support for default and generated columns

Issue - State: open - Opened by PMuellerELCA about 2 months ago
Labels: enhancement

#911 - Release 2.7.2

Pull Request - State: closed - Opened by zzeekk about 2 months ago

#910 - 815 openapi dataobject

Pull Request - State: closed - Opened by zzeekk about 2 months ago - 4 comments

#909 - 595 snowflake read transformer

Pull Request - State: closed - Opened by zzeekk 2 months ago - 1 comment

#907 - Skipping actions

Issue - State: open - Opened by mand35 3 months ago - 2 comments
Labels: enhancement

#906 - Bugfix/896 count expectation

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#905 - Implement Delta Sharing DataObject

Issue - State: open - Opened by zzeekk 3 months ago
Labels: enhancement

#904 - Add scaladoc comments to schema from case class (#765)

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#903 - DeduplicateAction should support a Schema Change between InputDO and OutputDO

Issue - State: closed - Opened by Geheiner 3 months ago - 7 comments
Labels: bug

#902 - Foreign Keys in configuration

Issue - State: open - Opened by iliassoto 4 months ago
Labels: discussion

#901 - 865 create primary keys + comments

Pull Request - State: open - Opened by iliassoto 4 months ago - 1 comment

#900 - HistorizeAction needs input schema in prepare phase

Issue - State: closed - Opened by zzeekk 4 months ago
Labels: bug

#899 - Getting started 2.7

Pull Request - State: closed - Opened by zzeekk 4 months ago

#898 - Add troubleshooting point

Pull Request - State: closed - Opened by pgruetter 4 months ago

#897 - PrimaryKey export in DataObjectsExporterDataObject

Issue - State: open - Opened by PMuellerELCA 4 months ago
Labels: enhancement

#896 - Count and TransferRate expectations broken

Issue - State: closed - Opened by PMuellerELCA 4 months ago - 1 comment
Labels: bug

#895 - Release 2.7.1

Pull Request - State: closed - Opened by zzeekk 4 months ago - 1 comment

#894 - Switch to XML native support library

Issue - State: open - Opened by PMuellerELCA 5 months ago - 2 comments
Labels: enhancement

#893 - CSV export to one single file

Issue - State: closed - Opened by PMuellerELCA 5 months ago - 2 comments
Labels: enhancement

#891 - Snowflake listPartitions lower case

Pull Request - State: closed - Opened by zzeekk 5 months ago - 2 comments

#890 - Snowflake listPartitions returns uppercase column names

Issue - State: closed - Opened by zzeekk 5 months ago
Labels: bug

#888 - fix typo in CompletenessExpectation class name (#880)

Pull Request - State: closed - Opened by zzeekk 5 months ago - 1 comment

#887 - overwrite Hocon parameter from SDLB input arguments

Issue - State: closed - Opened by mand35 5 months ago
Labels: enhancement

#886 - Add User authentication to SDLB (#859)

Pull Request - State: closed - Opened by zzeekk 5 months ago - 1 comment

#885 - Feature/618 improve main args config

Pull Request - State: closed - Opened by Geheiner 5 months ago - 2 comments

#884 - Feature/502 implement odata dataobject

Pull Request - State: closed - Opened by PMuellerELCA 5 months ago - 3 comments

#883 - CustomDataFrameAction Expectations

Pull Request - State: closed - Opened by zzeekk 5 months ago - 1 comment

#882 - Implement CustomDataFrameAction.expectations

Issue - State: closed - Opened by zzeekk 5 months ago
Labels: enhancement

#881 - Question: does SDL 2.7.0 work with Spark 3.5.2?

Issue - State: closed - Opened by AdiWehrli 5 months ago - 1 comment

#880 - Typo in CompletenessExpectation

Issue - State: closed - Opened by pgruetter 5 months ago
Labels: bug

#879 - IcebergTableDataObject: throw NoDataToProcessWarning if no snapshot is created (#878)

Pull Request - State: closed - Opened by zzeekk 6 months ago - 1 comment

#877 - Fix #872, #873

Pull Request - State: closed - Opened by zzeekk 6 months ago - 1 comment

#876 - Documentation update for v2.7.x

Pull Request - State: closed - Opened by zzeekk 6 months ago

#875 - Update executionModes.md

Pull Request - State: closed - Opened by Geheiner 6 months ago

#874 - Empty DataObject leads to NoMetricsReceivedException

Issue - State: closed - Opened by PMuellerELCA 6 months ago - 4 comments
Labels: bug

#873 - metricsFailCondition is not executed if Action is skipped

Issue - State: closed - Opened by zzeekk 6 months ago - 1 comment
Labels: bug

#872 - SubFeed metrics keep input values if skipped

Issue - State: closed - Opened by zzeekk 6 months ago - 3 comments
Labels: bug

#871 - Implement ColumnTransformer

Issue - State: open - Opened by zzeekk 6 months ago
Labels: enhancement

#870 - StandardizeColNamesTransformer for nested data types

Issue - State: open - Opened by zzeekk 6 months ago
Labels: enhancement

#869 - Read different rowTags from an XML File

Issue - State: open - Opened by zzeekk 6 months ago
Labels: enhancement

#868 - Implement transformPartitionValues for FileTransferAction

Issue - State: open - Opened by zzeekk 6 months ago
Labels: enhancement

#867 - Export Column Level Lineage

Issue - State: open - Opened by zzeekk 6 months ago - 1 comment
Labels: enhancement

#866 - Implement SQL/ELT Engine

Issue - State: open - Opened by zzeekk 6 months ago - 2 comments
Labels: enhancement

#865 - Create Primary/Foreign Keys

Issue - State: open - Opened by zzeekk 6 months ago - 6 comments
Labels: enhancement

#864 - IcebergTableDataObject: implement partitionOverwriteMode=dynamic (#863)

Pull Request - State: closed - Opened by zzeekk 6 months ago - 1 comment

#863 - IcebergTableDataObject: allow overwriting all partitions

Issue - State: closed - Opened by zzeekk 6 months ago
Labels: enhancement

#862 - Release 2.7.0

Pull Request - State: closed - Opened by zzeekk 6 months ago - 1 comment

#861 - Update SmartDataLakeBuilder.scala

Pull Request - State: closed - Opened by Geheiner 6 months ago - 1 comment

#860 - Feature/fix validation rule message

Pull Request - State: closed - Opened by Geheiner 6 months ago - 1 comment

#859 - Add User authentication to SDLB

Issue - State: closed - Opened by dnLeiting 6 months ago - 3 comments
Labels: enhancement

#858 - 856 fix bug, add test cases

Pull Request - State: closed - Opened by Geheiner 6 months ago - 1 comment

#857 - Update troubleshooting.md

Pull Request - State: closed - Opened by Geheiner 6 months ago

#855 - implement logging sdlb build githash and app version info (#853)

Pull Request - State: closed - Opened by zzeekk 7 months ago - 1 comment

#854 - Bump com.azure:azure-identity from 1.9.0 to 1.12.2 in /sdl-azure

Pull Request - State: closed - Opened by dependabot[bot] 7 months ago - 1 comment
Labels: dependencies

#853 - Improve logging sdlb version, add app version

Issue - State: closed - Opened by zzeekk 7 months ago
Labels: enhancement

#852 - Add missing partition columns to schema of SparkFileDataObjects (#851)

Pull Request - State: closed - Opened by zzeekk 7 months ago - 1 comment

#850 - implement FileIncrementalMoveMode.archiveInsidePartition (#849)

Pull Request - State: closed - Opened by zzeekk 7 months ago - 1 comment

#848 - implement RawFileDataObject.customPartitionLayout (#846)

Pull Request - State: closed - Opened by zzeekk 7 months ago - 1 comment

#847 - add count observation for input DataObjects (#782)

Pull Request - State: closed - Opened by zzeekk 7 months ago - 2 comments

#846 - Support arbitrary partition layout for RawFileDataObject

Issue - State: closed - Opened by zzeekk 8 months ago
Labels: enhancement

#845 - Fix creating no sample file for SparkFileDataObject if schema is fixed

Pull Request - State: closed - Opened by zzeekk 8 months ago - 1 comment

#844 - Dont create sample file for SparkFileDataObject if schema is fixed

Issue - State: closed - Opened by zzeekk 8 months ago
Labels: bug

#843 - Fix creating no sample file for SparkFileDataObject if schema is fixed

Pull Request - State: closed - Opened by zzeekk 8 months ago - 2 comments