Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / smart-data-lake/smart-data-lake issues and pull requests

#895 - Release 2.7.1

Pull Request - State: closed - Opened by zzeekk 10 days ago - 1 comment

#894 - Switch to XML native support library

Issue - State: open - Opened by PMuellerELCA 21 days ago - 2 comments
Labels: enhancement

#893 - CSV export to one single file

Issue - State: closed - Opened by PMuellerELCA 27 days ago - 2 comments
Labels: enhancement

#891 - Snowflake listPartitions lower case

Pull Request - State: closed - Opened by zzeekk 27 days ago - 2 comments

#890 - Snowflake listPartitions returns uppercase column names

Issue - State: closed - Opened by zzeekk 27 days ago
Labels: bug

#888 - fix typo in CompletenessExpectation class name (#880)

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#887 - overwrite Hocon parameter from SDLB input arguments

Issue - State: open - Opened by mand35 about 1 month ago
Labels: enhancement

#886 - Add User authentication to SDLB (#859)

Pull Request - State: closed - Opened by zzeekk about 1 month ago - 1 comment

#885 - Feature/618 improve main args config

Pull Request - State: open - Opened by Geheiner about 2 months ago - 1 comment

#884 - Feature/502 implement odata dataobject

Pull Request - State: closed - Opened by PMuellerELCA about 2 months ago - 3 comments

#883 - CustomDataFrameAction Expectations

Pull Request - State: closed - Opened by zzeekk about 2 months ago - 1 comment

#882 - Implement CustomDataFrameAction.expectations

Issue - State: closed - Opened by zzeekk about 2 months ago
Labels: enhancement

#881 - Question: does SDL 2.7.0 work with Spark 3.5.2?

Issue - State: closed - Opened by AdiWehrli about 2 months ago - 1 comment

#880 - Typo in CompletenessExpectation

Issue - State: closed - Opened by pgruetter about 2 months ago
Labels: bug

#879 - IcebergTableDataObject: throw NoDataToProcessWarning if no snapshot is created (#878)

Pull Request - State: closed - Opened by zzeekk about 2 months ago - 1 comment

#877 - Fix #872, #873

Pull Request - State: closed - Opened by zzeekk about 2 months ago - 1 comment

#876 - Documentation update for v2.7.x

Pull Request - State: closed - Opened by zzeekk about 2 months ago

#875 - Update executionModes.md

Pull Request - State: closed - Opened by Geheiner about 2 months ago

#874 - Empty DataObject leads to NoMetricsReceivedException

Issue - State: open - Opened by PMuellerELCA about 2 months ago - 3 comments
Labels: bug

#873 - metricsFailCondition is not executed if Action is skipped

Issue - State: closed - Opened by zzeekk about 2 months ago - 1 comment
Labels: bug

#872 - SubFeed metrics keep input values if skipped

Issue - State: closed - Opened by zzeekk about 2 months ago - 3 comments
Labels: bug

#871 - Implement ColumnTransformer

Issue - State: open - Opened by zzeekk about 2 months ago
Labels: enhancement

#870 - StandardizeColNamesTransformer for nested data types

Issue - State: open - Opened by zzeekk about 2 months ago
Labels: enhancement

#869 - Read different rowTags from an XML File

Issue - State: open - Opened by zzeekk about 2 months ago
Labels: enhancement

#868 - Implement transformPartitionValues for FileTransferAction

Issue - State: open - Opened by zzeekk about 2 months ago
Labels: enhancement

#867 - Export Column Level Lineage

Issue - State: open - Opened by zzeekk about 2 months ago - 1 comment
Labels: enhancement

#866 - Implement SQL/ELT Engine

Issue - State: open - Opened by zzeekk about 2 months ago - 2 comments
Labels: enhancement

#865 - Create Primary/Foreign Keys

Issue - State: open - Opened by zzeekk 2 months ago - 2 comments
Labels: enhancement

#864 - IcebergTableDataObject: implement partitionOverwriteMode=dynamic (#863)

Pull Request - State: closed - Opened by zzeekk 2 months ago - 1 comment

#863 - IcebergTableDataObject: allow overwriting all partitions

Issue - State: closed - Opened by zzeekk 2 months ago
Labels: enhancement

#862 - Release 2.7.0

Pull Request - State: closed - Opened by zzeekk 2 months ago - 1 comment

#861 - Update SmartDataLakeBuilder.scala

Pull Request - State: closed - Opened by Geheiner 2 months ago - 1 comment

#860 - Feature/fix validation rule message

Pull Request - State: closed - Opened by Geheiner 2 months ago - 1 comment

#859 - Add User authentication to SDLB

Issue - State: closed - Opened by dnLeiting 3 months ago - 3 comments
Labels: enhancement

#858 - 856 fix bug, add test cases

Pull Request - State: closed - Opened by Geheiner 3 months ago - 1 comment

#857 - Update troubleshooting.md

Pull Request - State: closed - Opened by Geheiner 3 months ago

#855 - implement logging sdlb build githash and app version info (#853)

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#854 - Bump com.azure:azure-identity from 1.9.0 to 1.12.2 in /sdl-azure

Pull Request - State: closed - Opened by dependabot[bot] 3 months ago - 1 comment
Labels: dependencies

#853 - Improve logging sdlb version, add app version

Issue - State: closed - Opened by zzeekk 3 months ago
Labels: enhancement

#852 - Add missing partition columns to schema of SparkFileDataObjects (#851)

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#850 - implement FileIncrementalMoveMode.archiveInsidePartition (#849)

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#848 - implement RawFileDataObject.customPartitionLayout (#846)

Pull Request - State: closed - Opened by zzeekk 3 months ago - 1 comment

#847 - add count observation for input DataObjects (#782)

Pull Request - State: closed - Opened by zzeekk 4 months ago - 2 comments

#846 - Support arbitrary partition layout for RawFileDataObject

Issue - State: closed - Opened by zzeekk 4 months ago
Labels: enhancement

#845 - Fix creating no sample file for SparkFileDataObject if schema is fixed

Pull Request - State: closed - Opened by zzeekk 4 months ago - 1 comment

#844 - Dont create sample file for SparkFileDataObject if schema is fixed

Issue - State: closed - Opened by zzeekk 4 months ago
Labels: bug

#843 - Fix creating no sample file for SparkFileDataObject if schema is fixed

Pull Request - State: closed - Opened by zzeekk 4 months ago - 2 comments

#842 - sdl-parent 2.6.1 not yet available?

Issue - State: closed - Opened by AdiWehrli 4 months ago - 3 comments

#841 - add support for managed DeltaLake tables (#839)

Pull Request - State: closed - Opened by zzeekk 4 months ago - 1 comment

#840 - Feature/608: add SparkPlan rule to fail if there is no data

Pull Request - State: closed - Opened by zzeekk 4 months ago - 1 comment

#839 - Allow writing data to managed Delta tables on Databricks

Issue - State: closed - Opened by zzeekk 4 months ago
Labels: enhancement

#838 - Upgrade spark 3.5.0 (#785)

Pull Request - State: closed - Opened by zzeekk 4 months ago - 2 comments

#837 - Release 2.6.1

Pull Request - State: closed - Opened by zzeekk 4 months ago

#836 - Jdbc connection pool settings

Pull Request - State: closed - Opened by zzeekk 4 months ago - 4 comments

#828 - 539 activate merge mode on existing tables

Pull Request - State: closed - Opened by ThierryGirod 5 months ago - 2 comments

#827 - #502 Added draft of ODataDataObject.scala

Pull Request - State: closed - Opened by PMuellerELCA 5 months ago - 2 comments
Labels: enhancement

#826 - Feature/col encrypt improve

Pull Request - State: closed - Opened by mand35 5 months ago - 1 comment

#825 - column encryption: null values and data types

Issue - State: closed - Opened by mand35 5 months ago - 1 comment
Labels: enhancement

#824 - 791 pre post sql for delta tables

Pull Request - State: closed - Opened by iliassoto 5 months ago - 1 comment

#819 - Try checkPermission method with two signatures

Pull Request - State: closed - Opened by iliassoto 6 months ago - 1 comment

#818 - Fix Databricks method checkPermission

Issue - State: closed - Opened by iliassoto 6 months ago
Labels: bug

#815 - WebserviceFileDataObject: Support reading schema from OpenAPI spec

Issue - State: open - Opened by zzeekk 6 months ago
Labels: enhancement

#813 - Better support for SDLB in Notebooks

Issue - State: closed - Opened by zzeekk 6 months ago
Labels: enhancement

#811 - Export state, config, schema and stats to UI endpoint

Issue - State: closed - Opened by zzeekk 6 months ago
Labels: enhancement

#808 - Allow Kafka SaslScram authentication without truststore

Issue - State: closed - Opened by zzeekk 6 months ago
Labels: enhancement

#807 - 805 error column dl hash missing

Pull Request - State: closed - Opened by ThierryGirod 6 months ago - 1 comment

#806 - 790 deduplicate transformer

Pull Request - State: closed - Opened by ThierryGirod 7 months ago - 1 comment

#805 - HistorizeAction error column dl_hash missing

Issue - State: closed - Opened by ThierryGirod 7 months ago
Labels: bug

#798 - Implement DataObjectStateIncrementalMode for DeltaLake- and IcebergTableDataObject

Issue - State: closed - Opened by zzeekk 7 months ago
Labels: enhancement

#795 - Improve AirbyteDataObject

Issue - State: closed - Opened by zzeekk 7 months ago
Labels: enhancement

#794 - Question: how to configure Hikari settings?

Issue - State: closed - Opened by AdiWehrli 7 months ago - 12 comments

#791 - Pre-/Post SQL for delta tables

Issue - State: closed - Opened by pgruetter 7 months ago - 1 comment
Labels: enhancement

#790 - Deduplicate Transformer

Issue - State: closed - Opened by ThierryGirod 7 months ago - 2 comments
Labels: enhancement, discussion

#787 - Iceberg 1.x does not support merge with schema change/evolution

Issue - State: closed - Opened by zzeekk 8 months ago - 1 comment
Labels: bug

#785 - Spark Update 3.5.0

Issue - State: closed - Opened by ThierryGirod 8 months ago - 2 comments
Labels: enhancement

#782 - Collect count metric for Action input.

Issue - State: closed - Opened by zzeekk 9 months ago - 3 comments
Labels: enhancement

#781 - Validate expectations when reading external data

Issue - State: closed - Opened by zzeekk 9 months ago - 1 comment
Labels: enhancement

#765 - Use ScalaDoc case class attribute descriptions as column descriptions in UI

Issue - State: open - Opened by zzeekk 10 months ago
Labels: enhancement, tricky

#715 - POM sdl-parent.xml > org.apache.commons:commons-compress must be unique

Issue - State: closed - Opened by AdiWehrli about 1 year ago - 4 comments
Labels: bug

#702 - Support creating/managing views by a specific Action

Issue - State: open - Opened by zzeekk over 1 year ago - 1 comment
Labels: enhancement

#673 - Activate search

Pull Request - State: closed - Opened by pgruetter over 1 year ago

#672 - State file: add inputIds and outputIds

Issue - State: open - Opened by zzeekk over 1 year ago
Labels: enhancement, good first issue

#671 - State file: add startTstmp and duration for Init and Prepare phases

Issue - State: open - Opened by zzeekk over 1 year ago - 3 comments
Labels: enhancement, good first issue

#670 - Feature/666 improve loganalytics logging

Pull Request - State: closed - Opened by zzeekk over 1 year ago - 1 comment

#669 - Feature/652 reading schema files from classpath location zku

Pull Request - State: closed - Opened by zzeekk over 1 year ago - 1 comment

#668 - Update getting-started to use Spark 3.3

Issue - State: open - Opened by pgruetter over 1 year ago
Labels: enhancement

#667 - Rewrite of Reference Transformations

Pull Request - State: closed - Opened by pgruetter over 1 year ago

#666 - Add hostname and executorId when logging to Azure LogAnalytics

Issue - State: closed - Opened by zzeekk over 1 year ago
Labels: enhancement

#665 - Python n:m transformer

Pull Request - State: closed - Opened by zzeekk over 1 year ago - 1 comment

#664 - Release 2.5.0

Pull Request - State: closed - Opened by pgruetter over 1 year ago

#663 - Feature/improve json schema

Pull Request - State: closed - Opened by zzeekk over 1 year ago - 1 comment

#662 - Definitions section in JSON schema is not conformant with schema specification

Issue - State: open - Opened by ddeuber over 1 year ago
Labels: enhancement

#662 - Definitions section in JSON schema is not conformant with schema specification

Issue - State: open - Opened by ddeuber over 1 year ago
Labels: enhancement