delta-io/delta-rs issues and pull requests

#3001 - Can not read/write DeltaTable on self hosted S3 Object Storage with self-signed ssl certificate

Issue - State: closed - Opened by legout 4 days ago - 1 comment
Labels: bug

#3000 - chore(deps): update openssl-src requirement from =300.3.1 to =300.4.1

Pull Request - State: open - Opened by dependabot[bot] 4 days ago
Labels: binding/python, dependencies

#2999 - chore(deps): update sqlparser requirement from 0.51 to 0.52

Pull Request - State: open - Opened by dependabot[bot] 4 days ago
Labels: binding/rust, dependencies

#2998 - chore(deps): update clap requirement from 3 to 4

Pull Request - State: open - Opened by dependabot[bot] 4 days ago
Labels: dependencies, delta-inspect

#2997 - feat: concurrent commit changes to `PartitionWriter`

Pull Request - State: open - Opened by Dan-J-D 5 days ago - 5 comments
Labels: binding/rust

#2996 - Answer "Why use DeltaLake?" question in the docs

Issue - State: open - Opened by braaannigan 7 days ago - 1 comment
Labels: enhancement

#2995 - Fix warnings in build

Issue - State: open - Opened by thomasfrederikhoeck 8 days ago - 1 comment
Labels: enhancement, good first issue

#2994 - fix: update object_store to 0.10.2

Pull Request - State: closed - Opened by thomasfrederikhoeck 8 days ago - 2 comments

#2993 - fix: jsonwriter should checkpoint by default

Pull Request - State: closed - Opened by jusjosj 9 days ago - 1 comment
Labels: binding/rust

#2992 - JsonWriter does not respect delta.checkpointInterval

Issue - State: closed - Opened by jusjosj 9 days ago
Labels: bug

#2991 - Faulty behavior on nullable columns when using `DeltaTable.merge`

Issue - State: open - Opened by joepatol 9 days ago - 1 comment
Labels: bug

#2990 - fix: num rows statistics

Pull Request - State: open - Opened by lewiszlw 9 days ago - 1 comment
Labels: binding/rust

#2989 - fix: jsonwriter and recordbatchwriter to respect stats skipping

Pull Request - State: open - Opened by jusjosj 10 days ago - 2 comments
Labels: binding/rust

#2988 - Delta-rs not using latest object_store which fails the table optimize

Issue - State: closed - Opened by gprashmi 10 days ago - 5 comments
Labels: bug

#2987 - fix: cache credential resolution with the AWS credential provider

Pull Request - State: closed - Opened by rtyler 10 days ago - 1 comment
Labels: binding/rust

#2986 - chore(deps): update hashbrown requirement from 0.14.3 to 0.15.1

Pull Request - State: open - Opened by dependabot[bot] 11 days ago
Labels: binding/rust, dependencies

#2985 - chore(deps): update thiserror requirement from 1 to 2

Pull Request - State: closed - Opened by dependabot[bot] 11 days ago
Labels: dependencies

#2984 - perf: close partition writers concurrently

Pull Request - State: closed - Opened by alexwilcoxson-rel 12 days ago - 1 comment
Labels: binding/rust

#2983 - perf: batch json decode checkpoint actions when writing to parquet

Pull Request - State: closed - Opened by alexwilcoxson-rel 12 days ago - 4 comments
Labels: binding/rust

#2982 - JsonWriter does not respect delta.dataSkippingStatsColumns

Issue - State: open - Opened by jusjosj 14 days ago - 1 comment
Labels: bug

#2981 - Error building commit

Issue - State: open - Opened by Dan-J-D 14 days ago
Labels: bug

#2980 - Concurrent merges not working >=0.19.0

Issue - State: open - Opened by echai58 15 days ago
Labels: bug

#2979 - Hello, I am conducting tests with Z-order optimization and the min_commit_interval. It seems that while optimize respects the min_commit_interval, the Z-order operation does not use this setting as expected.

Issue - State: open - Opened by ion-elgreco 15 days ago

#2978 - Pyarrow writer not encoding correct URL for partitions in delta table

Issue - State: open - Opened by gprashmi 17 days ago - 22 comments
Labels: bug

#2977 - docs: fix typo

Pull Request - State: closed - Opened by RyRyRyNguyen 17 days ago - 2 comments

#2976 - MAP types created in the Deltalake parquet do not follow the default naming convention.

Issue - State: closed - Opened by clarkr7 17 days ago - 5 comments
Labels: bug

#2975 - fix: decimal stat rounding overflow

Pull Request - State: open - Opened by gruuya 18 days ago - 2 comments
Labels: binding/rust

#2974 - Parse Decimal overflow

Issue - State: open - Opened by gruuya 18 days ago
Labels: bug

#2973 - Remove or hide unsupported catalogs from delta-rs documentation

Issue - State: open - Opened by omkar-foss 18 days ago - 1 comment
Labels: bug

#2972 - chore(deps): update reqwest requirement from 0.11.18 to 0.12.9

Pull Request - State: closed - Opened by dependabot[bot] 18 days ago - 1 comment
Labels: binding/rust, dependencies

#2971 - chore(deps): update which requirement from 6 to 7

Pull Request - State: closed - Opened by dependabot[bot] 18 days ago
Labels: binding/rust, dependencies

#2970 - fix: enable readerFeatures in minReaderVersion 3

Pull Request - State: closed - Opened by rjancewicz 21 days ago - 2 comments
Labels: binding/rust

#2969 - pyarrow `DictionaryArray` as partition column for `write_deltalake` fails

Issue - State: open - Opened by jorritsandbrink 21 days ago - 1 comment
Labels: bug

#2968 - rust engine consume a lot of memory compared to pyarrow

Issue - State: open - Opened by djouallah 22 days ago - 5 comments
Labels: bug, binding/python

#2967 - chore: bump the python package version to 0.21.0

Pull Request - State: closed - Opened by rtyler 23 days ago - 1 comment
Labels: binding/python

#2966 - chore: allow kernel::visitors to be public for Snapshot usage

Pull Request - State: open - Opened by rtyler 24 days ago - 1 comment
Labels: binding/rust

#2965 - [python] File size too large - maybe stats related

Issue - State: open - Opened by convoi 24 days ago
Labels: bug

#2964 - chore(deps): update openssl-src requirement from =300.3.1 to =300.4.0

Pull Request - State: closed - Opened by dependabot[bot] 25 days ago - 1 comment
Labels: binding/python, dependencies

#2964 - chore(deps): update openssl-src requirement from =300.3.1 to =300.4.0

Pull Request - State: closed - Opened by dependabot[bot] 25 days ago - 1 comment
Labels: binding/python, dependencies

#2963 - chore: be less verbose about zorder

Pull Request - State: closed - Opened by rtyler 28 days ago - 1 comment
Labels: binding/rust

#2963 - chore: be less verbose about zorder

Pull Request - State: closed - Opened by rtyler 28 days ago - 1 comment
Labels: binding/rust

#2962 - Spurious Error on Z-Order

Issue - State: closed - Opened by t0bygillespie 28 days ago

#2962 - Spurious Error on Z-Order

Issue - State: closed - Opened by t0bygillespie 28 days ago

#2961 - Merge function generating duplicated in the target table

Issue - State: closed - Opened by PecTheFabricator 29 days ago - 1 comment
Labels: bug

#2960 - fix: ensure the checkpoint decoder is regularly flushed

Pull Request - State: closed - Opened by rtyler 29 days ago - 1 comment
Labels: binding/rust

#2959 - chore: enable a dummy DCO app to unblock the merge queue

Pull Request - State: closed - Opened by rtyler 30 days ago - 1 comment

#2959 - chore: enable a dummy DCO app to unblock the merge queue

Pull Request - State: closed - Opened by rtyler 30 days ago - 1 comment

#2958 - Python DeltaTable does not support writes in multiple threads

Issue - State: open - Opened by PeterKeDer about 1 month ago - 4 comments
Labels: bug

#2957 - fix: always include the Invariants writerFeature when upgrading to v7

Pull Request - State: open - Opened by rtyler about 1 month ago - 7 comments
Labels: binding/python, binding/rust

#2957 - fix: always include the Invariants writerFeature when upgrading to v7

Pull Request - State: open - Opened by rtyler about 1 month ago - 7 comments
Labels: binding/python, binding/rust

#2956 - fix: dramatically reduce checkpoint memory consumption

Pull Request - State: closed - Opened by rtyler about 1 month ago - 1 comment
Labels: binding/rust

#2955 - chore: fix many warnings across the codebase

Pull Request - State: closed - Opened by hntd187 about 1 month ago - 1 comment
Labels: binding/rust

#2955 - chore: fix many warnings across the codebase

Pull Request - State: closed - Opened by hntd187 about 1 month ago - 1 comment
Labels: binding/rust

#2953 - docs: add merge guide

Pull Request - State: closed - Opened by avriiil about 1 month ago - 4 comments

#2953 - docs: add merge guide

Pull Request - State: closed - Opened by avriiil about 1 month ago - 4 comments

#2952 - HDFS support in rust

Issue - State: closed - Opened by nddashti about 1 month ago
Labels: question

#2950 - chore(deps): update hyper requirement from 0.14 to 1.5

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: binding/rust, dependencies

#2950 - chore(deps): update hyper requirement from 0.14 to 1.5

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: binding/rust, dependencies

#2949 - Use UV and Justfiles

Issue - State: open - Opened by ion-elgreco about 1 month ago - 2 comments
Labels: enhancement, help wanted, good first issue, binding/python

#2946 - Bump arrow to v53 to fix CVE

Issue - State: open - Opened by vavsab about 1 month ago - 1 comment
Labels: enhancement

#2945 - Optional fsspec filesystems

Issue - State: closed - Opened by legout about 1 month ago - 1 comment
Labels: enhancement

#2944 - _delta_log items missing createdTime field

Issue - State: closed - Opened by Petterhg about 1 month ago - 2 comments
Labels: bug

#2942 - feat(python): reading/writing transaction identifiers in python

Pull Request - State: closed - Opened by PeterKeDer about 1 month ago - 2 comments
Labels: binding/python

#2941 - chore(deps): update clap requirement from 3 to 4

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago - 1 comment
Labels: dependencies, delta-inspect

#2940 - fix: panics when creating delta tables in threads

Pull Request - State: closed - Opened by PeterKeDer about 1 month ago - 1 comment
Labels: binding/python

#2938 - Delta protocol version is too new for Athena DDL engine" Error When Querying Delta Tables

Issue - State: closed - Opened by marcoaanogueira about 1 month ago - 3 comments
Labels: bug

#2937 - Glue Crawler Error: "Internal Service Exception" when integrating Delta with Glue Catalog

Issue - State: closed - Opened by marcoaanogueira about 1 month ago - 2 comments
Labels: bug

#2936 - Double-read of json files from _delta_log

Issue - State: closed - Opened by MartinKolbAtWork about 1 month ago - 1 comment
Labels: bug, binding/rust

#2935 - chore: introduce some more writer tests to demonstrate schema promotion

Pull Request - State: closed - Opened by rtyler about 1 month ago - 1 comment
Labels: binding/python

#2934 - docs: minor fixes to the architecture documentation

Pull Request - State: closed - Opened by 0x26res about 1 month ago - 2 comments

#2933 - fix: Bump `delta_kernel` version for bug fixes

Pull Request - State: closed - Opened by lewiszlw about 1 month ago - 3 comments

#2932 - fix: improve errors on field cast failures

Pull Request - State: closed - Opened by jkylling about 1 month ago - 3 comments
Labels: binding/python, binding/rust

#2931 - fix: properly handle the different flavors of storage options keys

Pull Request - State: closed - Opened by rtyler about 1 month ago - 1 comment
Labels: binding/rust

#2930 - DynamoDB Locking Mechanism Failing for AWS S3 Storage Backend in Version 0.20.1

Issue - State: open - Opened by donotpush about 2 months ago - 6 comments
Labels: bug, binding/rust, storage/aws

#2929 - chore(deps): update reqwest requirement from 0.11.18 to 0.12.8

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: binding/rust, dependencies

#2928 - chore(deps): update hashbrown requirement from 0.14.3 to 0.15.0

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: binding/rust, dependencies

#2927 - chore(deps): update clap requirement from 3 to 4

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: dependencies, delta-inspect

#2926 - fix: update createdTime during schema evolution

Pull Request - State: closed - Opened by ion-elgreco about 2 months ago - 2 comments
Labels: binding/rust

#2925 - createdTime lost in metadata after schema change

Issue - State: closed - Opened by crpcrp about 2 months ago - 2 comments
Labels: bug, binding/rust

#2924 - fix: `ListingSchemaProvider` not forwarding custom `storage_options`

Pull Request - State: closed - Opened by Nordalf about 2 months ago - 2 comments
Labels: bug, binding/rust

#2923 - fix: remove unnecessary metadata action when overwriting partition

Pull Request - State: open - Opened by PeterKeDer about 2 months ago
Labels: binding/rust

#2922 - feat: read delta table using datafusion

Pull Request - State: open - Opened by PeterKeDer about 2 months ago - 11 comments
Labels: binding/python, binding/rust

#2921 - Bump version to 0.20.2

Pull Request - State: closed - Opened by PeterKeDer about 2 months ago - 1 comment
Labels: binding/python, binding/rust

#2920 - chore(deps): update hdfs-native-object-store requirement from 0.11 to 0.12

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: binding/rust, dependencies

#2919 - fix: cdc merge union schema order

Pull Request - State: closed - Opened by ion-elgreco about 2 months ago - 1 comment
Labels: binding/python, binding/rust

#2918 - chore: update the changelog with the latest rust merges

Pull Request - State: closed - Opened by rtyler about 2 months ago - 1 comment

#2917 - fix: avoid reference after move when building w/o datafusion

Pull Request - State: closed - Opened by rtyler about 2 months ago - 1 comment
Labels: binding/rust

#2916 - chore: bump the patch version for a 0.20.1 release

Pull Request - State: closed - Opened by rtyler about 2 months ago - 1 comment
Labels: binding/python, binding/rust

#2915 - Add `merge` guide to docs

Issue - State: closed - Opened by avriiil about 2 months ago - 1 comment
Labels: enhancement

#2914 - Cannot read transaction log of partitioned table with column mapping

Issue - State: open - Opened by rohanjain101 about 2 months ago
Labels: bug, binding/python, binding/rust

#2913 - docs: add adls backend docs

Pull Request - State: closed - Opened by avriiil about 2 months ago - 2 comments

#2912 - docs: add ADLS integration backend docs

Pull Request - State: closed - Opened by avriiil about 2 months ago

#2911 - docs: add ADLS backend integration doc page

Pull Request - State: closed - Opened by avriiil about 2 months ago

#2910 - delta-rs can't write to a table if datafusion is not enabled

Issue - State: closed - Opened by zhousun about 2 months ago - 1 comment

#2909 - fix: update storage_options when using DeltaTable in write_deltalake

Pull Request - State: open - Opened by NilsIrl about 2 months ago - 4 comments
Labels: binding/python

#2908 - Table merges fail when CDF is enabled due to column mismatches

Issue - State: closed - Opened by ldacey about 2 months ago - 2 comments
Labels: bug

#2907 - refactor: exposing CommitConflictError enum

Pull Request - State: closed - Opened by Filip-Dziuba about 2 months ago - 2 comments
Labels: binding/rust

#2906 - docs: add ADLS backend docs

Pull Request - State: closed - Opened by avriiil about 2 months ago - 4 comments

#2905 - Panic in python > 0.18.2 and <= 0.20.0 around tokio runtime

Issue - State: closed - Opened by dispalt about 2 months ago - 4 comments
Labels: bug

#2904 - docs: correct Minio docs fix typo

Pull Request - State: closed - Opened by avriiil about 2 months ago - 2 comments

GitHub / delta-io/delta-rs issues and pull requests