Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / delta-io/delta issues and pull requests

#1757 - Adopt sbt version to PEP440 compatible python package version

Pull Request - State: open - Opened by zhukovgreen over 1 year ago

#1756 - [Test] Check for operation type in Optimize Metrics tests

Issue - State: open - Opened by vkorukanti over 1 year ago - 1 comment
Labels: good first issue

#1755 - Make test cases portable with resource path

Pull Request - State: open - Opened by DonnyZone over 1 year ago - 2 comments

#1754 - [BUG] Unit tests fail in IDEA

Issue - State: open - Opened by DonnyZone over 1 year ago - 2 comments
Labels: bug

#1753 - Add REORG operation details in commit history

Pull Request - State: closed - Opened by vkorukanti over 1 year ago - 2 comments

#1752 - [DO_NOT_MERGE] Cherrypick commits to branch-2.4

Pull Request - State: closed - Opened by allisonport-db over 1 year ago

#1751 - Upgrade antlr4 to 4.9.3

Pull Request - State: closed - Opened by wangyum over 1 year ago - 1 comment

#1750 - Fix incorrect row index filter in CDCReader

Pull Request - State: closed - Opened by xupefei over 1 year ago - 1 comment

#1749 - [BUG] Problem with merge command when soing SCD2

Issue - State: open - Opened by zerodarkzone over 1 year ago - 1 comment
Labels: bug

#1748 - [BUG] UNSUPPORTED_CORRELATED_SCALAR_SUBQUERY in databricks sql

Issue - State: closed - Opened by teostergiou over 1 year ago - 1 comment
Labels: bug

#1747 - Protocol Specification for Row Commit Versions

Pull Request - State: open - Opened by tomvanbussel over 1 year ago

#1746 - [Feature Request] Correct schema metadata to be synced to Hive Metastore for delta tables

Issue - State: open - Opened by sirsha-chatterjee over 1 year ago - 2 comments
Labels: enhancement

#1745 - Update readme.md to include Docker and DockerHub

Pull Request - State: open - Opened by dennyglee over 1 year ago

#1744 - [Feature Request] Allow special characters for the column name

Issue - State: closed - Opened by parquetsharp over 1 year ago - 2 comments
Labels: enhancement

#1743 - Support insert-into-by-name for generated columns

Pull Request - State: closed - Opened by allisonport-db over 1 year ago

#1742 - Introduce DomainMetadata action to delta spec

Pull Request - State: closed - Opened by dabao521 over 1 year ago

#1741 - [Feature Request] Introduce DomainMetadata Action to delta

Issue - State: open - Opened by dabao521 over 1 year ago
Labels: enhancement

#1740 - Enable SQL support for MERGE with WHEN NOT MATCHED BY SOURCE

Pull Request - State: closed - Opened by johanl-db over 1 year ago

#1739 - [Feature Request] Support for java17 for delta

Issue - State: open - Opened by guptashailesh92 over 1 year ago - 1 comment
Labels: enhancement

#1738 - [Feature Request] Add number of rows to the `DeltaTable.detail()` method

Issue - State: open - Opened by chrimaho over 1 year ago - 1 comment
Labels: enhancement

#1737 - Adds tests for REPLACE WHERE SQL syntax

Pull Request - State: closed - Opened by allisonport-db over 1 year ago

#1736 - Remove the check that disables writes to Delta tables with deletion vectors

Pull Request - State: closed - Opened by vkorukanti over 1 year ago - 4 comments

#1735 - RESTORE support for Delta tables with deletion vectors.

Pull Request - State: closed - Opened by vkorukanti over 1 year ago - 1 comment

#1734 - [BUG] Handle `FileAlreadyExistsException` in S3DynamoDBLogStore

Issue - State: open - Opened by scottsand-db over 1 year ago - 1 comment
Labels: bug

#1733 - SHALLOW CLONE support for Delta tables with deletion vectors

Pull Request - State: closed - Opened by vkorukanti over 1 year ago - 1 comment

#1732 - Implement PURGE to remove DVs from Delta tables

Pull Request - State: closed - Opened by xupefei over 1 year ago

#1731 - Correctly recurse into nested arrays & maps in add/drop columns

Pull Request - State: closed - Opened by johanl-db over 1 year ago - 1 comment

#1727 - Spec: Request for more details on multi-part checkpoint

Issue - State: open - Opened by vigneshc over 1 year ago - 4 comments
Labels: bug

#1726 - [BUG] Zordering results in SparkUnsupportedOperationException

Issue - State: open - Opened by nityathacker over 1 year ago - 13 comments
Labels: bug

#1724 - [BUG] DeltaMergeBuilder' object has no attribute 'whenNotMatchedBySource for 2.3.0

Issue - State: closed - Opened by geoHeil over 1 year ago - 4 comments
Labels: bug

#1723 - Assign fresh Row IDs during commit

Pull Request - State: closed - Opened by johanl-db over 1 year ago

#1722 - [BACKPORT] Block writing to Delta tables that supports identity columns

Pull Request - State: closed - Opened by xupefei over 1 year ago - 8 comments

#1721 - Incremental loading for DeltaSourceSnapshot actions

Pull Request - State: closed - Opened by Kimahriman over 1 year ago - 5 comments

#1720 - Support Spark 3.4

Pull Request - State: closed - Opened by allisonport-db over 1 year ago - 1 comment

#1719 - [Feature Request] Support writing and reading struct stats in checkpoints

Issue - State: open - Opened by Tom-Newton over 1 year ago
Labels: enhancement

#1718 - [BUG] Z-Order with maxRecordsPerFile breaks the z-ordering

Issue - State: open - Opened by iiLaurens over 1 year ago - 1 comment
Labels: bug

#1717 - [Feature Request] Consolidate test selection/exclusion traits

Issue - State: open - Opened by xupefei over 1 year ago
Labels: enhancement

#1716 - [Feature Request] Refactor DV golden files to a independent trait

Issue - State: open - Opened by xupefei over 1 year ago
Labels: enhancement

#1715 - [Feature Request] Row Commit Versions

Issue - State: open - Opened by tomvanbussel over 1 year ago - 1 comment
Labels: enhancement

#1713 - Bump version in master to 2.4.0-SNAPSHOT after 2.3 release

Pull Request - State: closed - Opened by allisonport-db over 1 year ago

#1712 - Catch `RemoteFileChangedException` inside of `S3DynamoDBLogStore::read`

Pull Request - State: closed - Opened by scottsand-db over 1 year ago - 1 comment

#1710 - Support unblocking non-additive schema tracking with SQL conf

Pull Request - State: closed - Opened by jackierwzhang over 1 year ago

#1709 - Support CDC streaming for non-additive schema tracking

Pull Request - State: closed - Opened by jackierwzhang over 1 year ago

#1708 - Rewrite OPTIMIZE to use Spark Table Resolution

Pull Request - State: closed - Opened by LukasRupprecht over 1 year ago

#1707 - [Feature Request] Improve unit test execution time

Issue - State: open - Opened by felipepessoto over 1 year ago - 1 comment
Labels: enhancement

#1706 - Support Auto Vacuum

Pull Request - State: closed - Opened by zml1206 over 1 year ago - 4 comments

#1704 - [DELETE with DVs] Allow reading CDF from files with Deletion Vectors - Part 2/2

Pull Request - State: closed - Opened by xupefei over 1 year ago - 3 comments

#1703 - Drop stats for streaming source file index

Pull Request - State: closed - Opened by Kimahriman over 1 year ago - 1 comment

#1702 - Introduce row ID write table feature and table property

Pull Request - State: closed - Opened by johanl-db over 1 year ago

#1699 - [Feature Request] Don't collect all files in DeltaSourceSnapshot

Issue - State: closed - Opened by Kimahriman over 1 year ago - 6 comments
Labels: enhancement

#1698 - [Feature Request] Add support for Storage Partitioned Joins (SPJ) introduced in Spark v3.3

Issue - State: open - Opened by shrukul over 1 year ago - 2 comments
Labels: enhancement

#1697 - replaced mergeInto.run With toDataset in deltaMergeBuilder

Pull Request - State: closed - Opened by sherlockbeard over 1 year ago - 5 comments

#1696 - [Feature Request] Support Spark 3.4

Issue - State: closed - Opened by josecsotomorales over 1 year ago - 10 comments
Labels: enhancement

#1695 - Block writing to Delta tables that supports identity columns

Pull Request - State: closed - Opened by xupefei over 1 year ago - 2 comments

#1694 - [BUG] OSS break Identity (writer version 6) protocol

Issue - State: closed - Opened by felipepessoto over 1 year ago - 7 comments
Labels: bug

#1692 - [Feature Request] Permanently delete specific records from delta tables to comply with GDPR

Issue - State: open - Opened by broeks-m over 1 year ago - 3 comments
Labels: enhancement

#1691 - [Feature Request] Partition pruning support for file listing during Vacuum

Issue - State: closed - Opened by arunravimv over 1 year ago
Labels: enhancement

#1683 - Bump version in master to 2.4.0-SNAPSHOT after 2.3.0 release

Pull Request - State: closed - Opened by allisonport-db over 1 year ago - 1 comment

#1682 - Update checkpoint schema description

Pull Request - State: open - Opened by felipepessoto over 1 year ago - 9 comments

#1679 - [Design Doc] Catalog implementation for AWS Glue Data Catalog

Issue - State: open - Opened by moomindani over 1 year ago - 14 comments
Labels: enhancement

#1678 - [DELETE with DVs] Make sure DML commands work with DVs

Pull Request - State: closed - Opened by xupefei over 1 year ago - 1 comment

#1676 - Support VACUUM command on Delta tables with DVs

Pull Request - State: closed - Opened by vkorukanti over 1 year ago

#1675 - [BUG] Couldn't load the table due to hadoop checksum failed.

Issue - State: closed - Opened by horizonzy over 1 year ago - 4 comments
Labels: bug

#1673 - [QUESTION] The effect of applying ZORDER to a column in a table

Issue - State: open - Opened by chris-void-777 over 1 year ago - 5 comments

#1671 - [BUG] [Python Typing] Use Mapping instead of Dict for arguments

Issue - State: open - Opened by pspeter over 1 year ago - 5 comments
Labels: bug

#1670 - [DELETE with DVs] Implement packing multiple DVs into one file

Pull Request - State: closed - Opened by vkorukanti over 1 year ago

#1668 - Add pypi downloads to README

Pull Request - State: closed - Opened by MrPowers over 1 year ago

#1667 - Add show partitions for delta table

Pull Request - State: open - Opened by Maks-D over 1 year ago - 2 comments

#1664 - [BUG] Missing spec for delta_log/00000000000000000000.crc files

Issue - State: open - Opened by felipepessoto over 1 year ago - 6 comments
Labels: bug

#1663 - Update protocol.md to reflect new supported type TimestampNTZ

Pull Request - State: closed - Opened by rahulsmahadev over 1 year ago - 1 comment

#1645 - Add support for Structs evolution in MapType value

Pull Request - State: closed - Opened by Orpheuz over 1 year ago - 8 comments

#1642 - Fix bugs around blocking write operations on DV enabled tables

Pull Request - State: closed - Opened by vkorukanti over 1 year ago

#1636 - Remove the old scala LogStores

Issue - State: open - Opened by scottsand-db over 1 year ago - 8 comments
Labels: enhancement

#1635 - [MINOR] Bintray replacement for spark-packages.org

Pull Request - State: closed - Opened by DonnyZone over 1 year ago - 2 comments

#1619 - [BUG]: Unable to update schema using DeltaLake DeltaMergeBuilder (Python API v2.2.0)

Issue - State: open - Opened by keenborder786 over 1 year ago - 4 comments
Labels: bug

#1618 - [WIP] Add support for `userMetadata` argument to delta update, delete, and merge

Pull Request - State: open - Opened by PeterDowdy over 1 year ago - 3 comments

#1617 - Add config validation to upgradeTableProtocol

Pull Request - State: open - Opened by Orpheuz over 1 year ago - 5 comments

#1614 - [Question] py4j.protocol.Py4JJavaError: An error occurred while calling o38.applySchemaToPythonRDD

Issue - State: open - Opened by aimtsou over 1 year ago - 10 comments
Labels: question

#1595 - Block manifest file generation when DVs are present

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1593 - [DELETE with DVs] Update `DeltaParquetFileFormat` to return a row index

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1592 - [DELETE with DVs] Add a bitmap aggegator UDAF

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1591 - [Feature Request] Support DELETE command with Deletion Vectors

Issue - State: open - Opened by vkorukanti almost 2 years ago
Labels: enhancement

#1578 - Support OPTIMIZE on Delta tables with DVs

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1577 - Support limit pushdown on Delta tables with DVs.

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1576 - Support checkpoints on Delta tables with deletion vectors

Pull Request - State: closed - Opened by vkorukanti almost 2 years ago

#1572 - [BUG] `Database 'delta' not found` during `DeltaTable.createIfNotExists()`

Issue - State: open - Opened by iirekm almost 2 years ago - 4 comments
Labels: bug

#1570 - [Feature Request] Support for Spark Connect

Issue - State: open - Opened by tomvanbussel almost 2 years ago - 2 comments
Labels: enhancement

#1568 - [Feature Request] More performant transaction log parsing for Azure

Issue - State: open - Opened by Tom-Newton almost 2 years ago - 12 comments
Labels: enhancement

#1563 - [BUG] partition pruning doesnt work with merge operation

Issue - State: open - Opened by abintrd almost 2 years ago - 2 comments
Labels: bug