Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / delta-io/delta issues and pull requests

#1553 - [Feature Request] Manipulate commit timestamp for Testing.

Issue - State: open - Opened by tnk-dev almost 2 years ago - 2 comments
Labels: enhancement

#1551 - [BUG] Merges (when merging schema) can silently drop fields that change type

Issue - State: closed - Opened by mikix almost 2 years ago - 1 comment
Labels: bug

#1550 - Improve Z-Order Python tests

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1548 - [BUG] commitInfo fields format's are not treated as optional

Issue - State: open - Opened by rtyler almost 2 years ago - 3 comments
Labels: bug

#1541 - [1444] Floor Function Partition

Pull Request - State: closed - Opened by corymaklin almost 2 years ago - 3 comments

#1532 - [Spark] Support dryRun for VACUUM Scala/Python API

Pull Request - State: open - Opened by sezruby almost 2 years ago - 8 comments

#1528 - Add `DeletionVectorDescriptor` to represent DV metadata in `DeltaLog`

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1525 - Optimize Min/Max using Delta metadata

Pull Request - State: closed - Opened by felipepessoto almost 2 years ago - 20 comments

#1521 - [BUG] MergeIntoCommand not visible in QueryExecutionListener when using Python/Scala API

Issue - State: closed - Opened by sh0ck-wave almost 2 years ago - 9 comments
Labels: bug

#1518 - Dependency vulnerabilities

Issue - State: closed - Opened by Maccce almost 2 years ago - 6 comments

#1505 - Support SHALLOW CLONE for Delta Lake

Pull Request - State: closed - Opened by jackierwzhang almost 2 years ago - 1 comment

#1503 - [Feature Request] Refresh table manifest files for selected partitions only

Issue - State: open - Opened by zevektor almost 2 years ago - 2 comments
Labels: enhancement

#1495 - Add support for `LIMIT` push down during query planning to reduce number of files scanned

Pull Request - State: closed - Opened by scottsand-db almost 2 years ago - 5 comments

#1491 - Enable ability to read stream from delta table without duplicates. Only blind commits.

Pull Request - State: closed - Opened by GrigorievNick almost 2 years ago - 2 comments

#1490 - [Feature Request] Enable ability to read stream from delta table without duplicates.

Issue - State: closed - Opened by GrigorievNick almost 2 years ago - 12 comments
Labels: enhancement

#1487 - Add utilities for encoding/decoding of Deletion Vectors bitmap

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1486 - Add RoaringBitmapArray to store indices of rows deleted in a data file

Pull Request - State: closed - Opened by vkorukanti about 2 years ago - 2 comments

#1485 - [Feature Request] Support reading Delta tables with Deletion Vectors

Issue - State: closed - Opened by vkorukanti about 2 years ago - 2 comments
Labels: enhancement

#1478 - [Feature Request] Delta Sync for metadata sync to HMS/Glue

Issue - State: closed - Opened by agrawalreetika about 2 years ago - 14 comments
Labels: enhancement

#1468 - [WIP] V2 reader support

Pull Request - State: closed - Opened by Kimahriman about 2 years ago - 2 comments

#1455 - [Feature Request] Refactor Delta configuration SQLConf override key to remove `databricks` prefix

Issue - State: open - Opened by scottsand-db about 2 years ago - 6 comments
Labels: enhancement

#1453 - [Feature Request] Save with specified compression codec after optimized-based compaction

Issue - State: closed - Opened by xuan1905 about 2 years ago - 5 comments
Labels: enhancement

#1452 - Ceil function partition added

Pull Request - State: closed - Opened by sherlockbeard about 2 years ago - 3 comments

#1448 - Cherry-pick to branch-2.0 for 2.0.1 release

Pull Request - State: closed - Opened by vkorukanti about 2 years ago - 2 comments

#1447 - Cherrypick commits to branch-2.1 for 2.1.1 release

Pull Request - State: closed - Opened by vkorukanti about 2 years ago - 2 comments

#1445 - [Feature Request] Automatically generate partition filters for generated columns using the timestamp trunc function

Issue - State: closed - Opened by allisonport-db about 2 years ago - 4 comments
Labels: enhancement, good first issue

#1444 - [Feature Request] Automatically generate partition filters for generated columns using the floor function

Issue - State: open - Opened by allisonport-db about 2 years ago - 1 comment
Labels: enhancement, good first issue

#1438 - [FEATURE REQUEST] DEFAULT values for columns

Issue - State: open - Opened by azure2439 about 2 years ago - 7 comments
Labels: enhancement

#1433 - Prevent Protocol Downgrades during RESTORE in Delta

Pull Request - State: closed - Opened by vkorukanti about 2 years ago

#1432 - Prevent Protocol Downgrades during RESTORE in Delta

Pull Request - State: closed - Opened by vkorukanti about 2 years ago

#1431 - Fix Delta source initialization issue when using AvailableNow

Pull Request - State: closed - Opened by vkorukanti about 2 years ago

#1429 - Correctly use `initializeStats` in `DataSkippingStatsTracker`

Pull Request - State: closed - Opened by vkorukanti about 2 years ago

#1427 - [BUG] autoCompact not working

Issue - State: open - Opened by 0xdarkman about 2 years ago - 6 comments
Labels: bug

#1423 - [BUG] metric `numDeletedRows` missing in Delta log when DELETING complete partition

Issue - State: closed - Opened by keen85 about 2 years ago - 7 comments
Labels: bug

#1416 - [1410] Fix S3DynamoDBLogStore concurrent writer bug

Pull Request - State: closed - Opened by scottsand-db about 2 years ago - 8 comments
Labels: waiting for merge

#1387 - [Feature Request] Enable Clone of Delta Lake tables

Issue - State: open - Opened by dennyglee about 2 years ago - 7 comments
Labels: enhancement

#1367 - [Feature Request] Deletion Vectors to speed up DML operations

Issue - State: closed - Opened by tdas about 2 years ago - 5 comments
Labels: enhancement

#1361 - Show key metrics after running `.merge(...)....execute()`

Issue - State: open - Opened by chrimaho about 2 years ago - 5 comments
Labels: enhancement

#1359 - [BUG] Memory leak in a long running Spark Thrift Server with Delta Lake workloads

Issue - State: open - Opened by dnskr about 2 years ago - 38 comments
Labels: bug

#1358 - Enable streaming / CDF streaming reads on column mapping enabled tables with fewer limitations

Pull Request - State: closed - Opened by jackierwzhang about 2 years ago - 1 comment
Labels: waiting for merge

#1315 - Use ThreadUtils.parmap for optimize

Pull Request - State: closed - Opened by Kimahriman over 2 years ago - 3 comments
Labels: waiting for merge

#1305 - Fix ConflictChecker for READ-APPEND after OPTIMIZE

Pull Request - State: open - Opened by sezruby over 2 years ago - 12 comments

#1298 - Initialized spark session with “configure_spark_with_delta_pip” stuck

Issue - State: closed - Opened by BShraman over 2 years ago - 14 comments
Labels: bug

#1296 - Don't enforce null checks on fields inside nullable structs

Pull Request - State: open - Opened by Kimahriman over 2 years ago - 4 comments

#1294 - Allow schema evolution in nested fields unrelated to generated columns

Pull Request - State: open - Opened by Kimahriman over 2 years ago - 2 comments

#1293 - Update FAQ to say the it is impossible to move a deltalake in S3

Issue - State: open - Opened by ABRB554 over 2 years ago - 3 comments

#1288 - Support AS OF SQL syntax for time travel queries on Delta Table

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1277 - [BUG] The specified path does not exist.", 404, GET

Issue - State: closed - Opened by 0xdarkman over 2 years ago - 30 comments
Labels: question

#1271 - Cherry-pick commits from master to branch-2.0

Pull Request - State: closed - Opened by vkorukanti over 2 years ago

#1262 - Enable WriteSerializable Isolation Level

Pull Request - State: open - Opened by koertkuipers over 2 years ago - 7 comments

#1261 - [Feature Request] Enable WriteSerializable Isolation Level

Issue - State: open - Opened by koertkuipers over 2 years ago
Labels: enhancement

#1259 - [Feature Request] Set userId, userName, notebook, clusterId in delta history

Issue - State: closed - Opened by keen85 over 2 years ago - 4 comments
Labels: enhancement

#1257 - Upgrade Delta to use Apache Spark 3.3.0

Pull Request - State: closed - Opened by vkorukanti over 2 years ago - 3 comments
Labels: waiting for merge

#1255 - #1032 Changes to support SHOW CREATE TABLE

Pull Request - State: open - Opened by zpappa over 2 years ago - 6 comments

#1239 - [BUG] Column invariant not enforced on write

Issue - State: open - Opened by wjones127 over 2 years ago - 9 comments
Labels: bug

#1215 - [BUG] INSERT INTO with generated columns fails (not enough data columns)

Issue - State: closed - Opened by jaceklaskowski over 2 years ago - 8 comments
Labels: bug

#1198 - Support Optimized Write

Pull Request - State: open - Opened by sezruby over 2 years ago - 9 comments

#1196 - Can I write data from remote machine?

Issue - State: closed - Opened by EasyLuck over 2 years ago - 8 comments

#1170 - Apache Druid - Delta Connector

Issue - State: open - Opened by Thelin90 over 2 years ago - 3 comments
Labels: enhancement

#1158 - [Feature Request] OPTIMIZED WRITE

Issue - State: closed - Opened by sezruby over 2 years ago - 2 comments
Labels: enhancement

#1156 - Support Auto Compaction

Pull Request - State: open - Opened by sezruby over 2 years ago - 21 comments
Labels: enhancement

#1152 - [BUG] `LogStore` class not found, from pyspark

Issue - State: closed - Opened by bobrippling over 2 years ago - 27 comments
Labels: bug

#1151 - [BUG] Performance downgrade using OPTIMIZE (compaction) with Trino

Issue - State: closed - Opened by Dearkano over 2 years ago - 11 comments
Labels: bug

#1137 - [ZOrderBy] Add `range_partition_id` expression

Pull Request - State: closed - Opened by vkorukanti over 2 years ago

#1134 - Support multi-dimensional clustering of data using Z-Order curves

Issue - State: closed - Opened by vkorukanti over 2 years ago
Labels: enhancement

#1129 - [BUG] - Inconsistent behavior between opensource delta and databricks runtime

Issue - State: open - Opened by bugsbunny1101 over 2 years ago - 4 comments
Labels: bug

#1124 - [Feature Request] LogStore integration test framework

Issue - State: open - Opened by scottsand-db over 2 years ago - 6 comments
Labels: enhancement, good first issue

#1110 - Fix python test failures

Pull Request - State: closed - Opened by vkorukanti over 2 years ago

#1100 - [Feature Request] SQL syntax for GENERATED columns in OSS

Issue - State: open - Opened by kpe over 2 years ago - 19 comments
Labels: enhancement, acknowledged

#1096 - Fix double file scan from nested schema pruning

Pull Request - State: open - Opened by Kimahriman over 2 years ago - 18 comments

#1085 - Update Delta version to 1.2.1 in integration tests

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1084 - 1.2.1 cherrypicks

Pull Request - State: closed - Opened by vkorukanti over 2 years ago - 1 comment

#1083 - Revert usages of Delta*Exception extending DeltaThrowable

Pull Request - State: closed - Opened by vkorukanti over 2 years ago - 4 comments

#1082 - Fix exception handling in Python APIs

Pull Request - State: closed - Opened by vkorukanti over 2 years ago

#1078 - Fix ClassLoader issue when loading error mapping resource file in `--packages` mode

Pull Request - State: closed - Opened by vkorukanti over 2 years ago - 3 comments
Labels: waiting for merge

#1072 - Add support for GENERATED ALWAYS AS IDENTITY in DeltaTableBuilder

Issue - State: closed - Opened by norbitek over 2 years ago - 14 comments
Labels: enhancement

#1065 - Update Delta version to 1.2.0 in integration tests

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1058 - Upgrade version to 1.3.0-SNAPSHOT

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1045 - [Feature Request] Hive Metastore compatibility between different systems

Issue - State: open - Opened by zsxwing over 2 years ago - 13 comments
Labels: enhancement

#1038 - Show create table statement is not working for delta lake tables

Issue - State: closed - Opened by Sharan441 over 2 years ago - 2 comments

#1030 - Add RESTORE operation metrics

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1029 - Add OPTIMIZE operation commit metrics in DeltaLog

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#1013 - java.lang.ClassNotFoundException: io.delta.sql.DeltaSparkSessionExtension

Issue - State: closed - Opened by journey-wang over 2 years ago - 4 comments
Labels: documentation, acknowledged

#998 - Add support for Restore SQL Command in Delta OSS

Pull Request - State: closed - Opened by vkorukanti over 2 years ago

#996 - Support "SHOW PARTITIONS"

Issue - State: open - Opened by zsxwing over 2 years ago - 5 comments
Labels: enhancement

#968 - Minor improvements to Restore Python API

Pull Request - State: closed - Opened by vkorukanti over 2 years ago
Labels: waiting for merge

#934 - Add support for optimize (file compaction) on Delta tables

Pull Request - State: closed - Opened by vkorukanti almost 3 years ago - 16 comments

#901 - Table Delta in Athena

Issue - State: closed - Opened by JosefinaArayaTapia almost 3 years ago - 3 comments
Labels: question, acknowledged

#898 - delta writing to adls gen2 file system

Issue - State: closed - Opened by ashishkshukla almost 3 years ago - 9 comments

#870 - Parquet column encryption support for Delta

Issue - State: closed - Opened by RobindeGrootNL almost 3 years ago - 5 comments

#860 - Not null invariant incorrectly fails on non-nullable field inside a nullable struct

Issue - State: open - Opened by Kimahriman almost 3 years ago - 24 comments
Labels: bug, acknowledged

#857 - Unable to write metadata to delta table using scala api

Issue - State: open - Opened by GeekSheikh almost 3 years ago - 14 comments
Labels: enhancement, good first issue

#843 - maxBytesPerTrigger setting not working as expected while streaming from Delta lake table

Issue - State: closed - Opened by mahanoor786 almost 3 years ago - 6 comments
Labels: bug, acknowledged

#832 - Multiple-table transaction

Issue - State: open - Opened by marcin-workfellow about 3 years ago - 2 comments
Labels: enhancement

#831 - Cannot use `SET NOT NULL` constraint.

Issue - State: open - Opened by scottsand-db about 3 years ago - 9 comments
Labels: bug, enhancement

#827 - Confusing discrepancy between `replace` and `createOrReplace`.

Issue - State: open - Opened by madten about 3 years ago - 6 comments
Labels: bug, enhancement, acknowledged

#826 - Delete and Update subquery support

Issue - State: open - Opened by tdas about 3 years ago - 12 comments
Labels: enhancement