Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / delta-io/delta issues and pull requests
#3473 - [Spark] Allowing Row Tracking enablement only txn to not fail concurrent no metadata update txns
Pull Request -
State: closed - Opened by longvu-db 3 months ago
#3472 - [Spark] Add tests that check row tracking preservation works on DMLs for backfilled enabled tables
Pull Request -
State: closed - Opened by longvu-db 3 months ago
#3471 - [Protocol] Column Invariants definition clarification
Issue -
State: open - Opened by li-boxuan 3 months ago
- 1 comment
Labels: bug
#3470 - [Spark] Uses java-based coordinated commits classes in Delta Spark
Pull Request -
State: closed - Opened by LukasRupprecht 4 months ago
#3469 - [Spark] populate Delta clone override table properties to catalog
Pull Request -
State: closed - Opened by lzlfred 4 months ago
#3468 - [BUG][Spark] jackson.core.JsonParseException raised when quote character present in delta table column comment
Issue -
State: open - Opened by AugustoBarros 4 months ago
- 1 comment
Labels: bug
#3467 - [Spark] Add Row Tracking Backfill Conflict Checker RemoveFile rule
Pull Request -
State: closed - Opened by longvu-db 4 months ago
#3466 - [Kernel] Configure code formatter for Java Code
Pull Request -
State: closed - Opened by nastra 4 months ago
- 4 comments
#3465 - [Spark] Fix DeltaConnectPlannerSuite by copying the moved createDummySessionHolder
Pull Request -
State: closed - Opened by dillitz 4 months ago
#3464 - [KERNEL][VARIANT] Variant schema deserialization
Pull Request -
State: closed - Opened by richardc-db 4 months ago
Labels: kernel
#3463 - [3.2 Cherry Pick] [#3423] Fix unnecessary DynamoDB GET calls during LogStore::listFrom VACUUM calls
Pull Request -
State: closed - Opened by scottsand-db 4 months ago
- 1 comment
#3462 - [3.1 Cherry Pick] [#3423] Fix unnecessary DynamoDB GET calls during LogStore::listFrom VACUUM calls
Pull Request -
State: closed - Opened by scottsand-db 4 months ago
- 1 comment
#3461 - [3.0 Cherry Pick] [#3423] Fix unnecessary DynamoDB GET calls during LogStore::listFrom VACUUM calls
Pull Request -
State: closed - Opened by scottsand-db 4 months ago
- 1 comment
#3460 - [UNIFORM] Remove the `setSchema` patch
Pull Request -
State: open - Opened by Fokko 4 months ago
- 1 comment
#3459 - [Spark] Support clone and restore for Identity Columns
Pull Request -
State: closed - Opened by zhipengmao-db 4 months ago
- 2 comments
#3458 - [Spark] Add commit version and logical records in Delta DML metrics
Pull Request -
State: closed - Opened by cstavr 4 months ago
#3457 - [Spark] Block unsupported operations on identity columns
Pull Request -
State: closed - Opened by zhipengmao-db 4 months ago
#3456 - [Spark] Execute MERGE using Dataframe API in Scala
Pull Request -
State: closed - Opened by johanl-db 4 months ago
- 2 comments
#3455 - [Kernel] Add a `editable` property to `TableConfig`
Issue -
State: closed - Opened by vkorukanti 4 months ago
Labels: enhancement, kernel
#3454 - [Spark] Allow stale reads when commit coordinator has not been registered
Pull Request -
State: closed - Opened by dhruvarya-db 4 months ago
#3453 - Use correct partition/batch size for Delta Uniform iceberg conversion
Pull Request -
State: closed - Opened by lzlfred 4 months ago
#3452 - [Spark] Add annotation for merge materialize source stage of merge
Pull Request -
State: closed - Opened by juliuszsompolski 4 months ago
- 1 comment
#3451 - [Spark] Fix AttributeReference mismatch for readChangeFeed queries coming from Spark Connect
Pull Request -
State: closed - Opened by dillitz 4 months ago
- 2 comments
#3450 - [Feature Request][Spark] Add Row Tracking Backfill
Issue -
State: open - Opened by longvu-db 4 months ago
Labels: enhancement
#3449 - [Spark] Add RowTrackingBackfillCommand
Pull Request -
State: closed - Opened by longvu-db 4 months ago
#3448 - [DO_NOT_MERGE] Delta Connect Python client
Pull Request -
State: open - Opened by allisonport-db 4 months ago
#3445 - [Kernel] Add support for nested schema fields
Pull Request -
State: closed - Opened by nastra 4 months ago
#3444 - Add DELTA_TESTING=1 environment variable when running Python tests
Pull Request -
State: closed - Opened by zhipengmao-db 4 months ago
- 3 comments
#3443 - [Spark] Handle type mismatches in Delta streaming sink
Pull Request -
State: closed - Opened by johanl-db 4 months ago
#3436 - [Feature Request] FSCK REPAIR TABLE sql command
Issue -
State: open - Opened by Sovima 4 months ago
- 2 comments
Labels: enhancement
#3435 - [Kernel] Add get method to FieldMetadata for easier extraction of value in the correct type
Pull Request -
State: closed - Opened by nastra 4 months ago
#3431 - [Spark][UniForm] Add test suite/utils for enable UniForm without rewrite
Pull Request -
State: closed - Opened by xzhseh 4 months ago
#3430 - [Spark] Fix the inconsistencies in min/max Delta Log stats for special characters
Pull Request -
State: closed - Opened by sumeet-db 4 months ago
#3429 - [Spark][UniForm] Add test suite/utils for enable UniForm without rewrite
Pull Request -
State: closed - Opened by xzhseh 4 months ago
#3428 - [DELTA] Catch fatal error in error matching in commitLarge
Pull Request -
State: closed - Opened by yumingxuanguo-db 4 months ago
#3427 - [Feature Request][Kernel] Handle nested schemas when assigning id / physical name for column mapping mode
Issue -
State: closed - Opened by nastra 4 months ago
Labels: enhancement
#3426 - [Kernel] Track nested fields in ArrayType / MapType
Pull Request -
State: closed - Opened by nastra 4 months ago
#3425 - [#3423] Fix unnecessary DynamoDB GET calls during LogStore::listFrom VACUUM calls
Pull Request -
State: open - Opened by scottsand-db 4 months ago
#3424 - [Feature Request] Add a salt column to DeltaOptimizeWriterExec
Issue -
State: open - Opened by sezruby 4 months ago
- 2 comments
Labels: enhancement
#3423 - [BUG] ProvisionedThroughputExceededException when performing VACUUM using S3DynamoDBLogStore
Issue -
State: open - Opened by scottsand-db 4 months ago
Labels: bug
#3422 - [Spark] Flip isDeltaTable.throwOnError to true
Pull Request -
State: closed - Opened by larsk-db 4 months ago
#3421 - [Feature Request][DeltaTable]Read spark table from hive metastore
Issue -
State: open - Opened by dishkakrauch 4 months ago
- 1 comment
Labels: enhancement
#3420 - [Feature Request][Storage]Remove CoordinatedCommitsUtils from Storage test package
Issue -
State: open - Opened by EstherBear 4 months ago
Labels: enhancement
#3419 - [Feature Request][Kernel] Add methods to FieldMetadata to retrieve metadata items with the correct type
Issue -
State: open - Opened by nastra 4 months ago
Labels: enhancement
#3418 - [Spark] Add Delta log throttling class
Pull Request -
State: closed - Opened by larsk-db 4 months ago
- 2 comments
#3417 - [Spark] Upgrade Spark version to 3.5.2
Pull Request -
State: closed - Opened by vkorukanti 4 months ago
- 3 comments
#3416 - [Spark][Kernel][Protocol] Merge InCommitTimestamp RFC, and remove the -preview suffix from feature name and configs.
Pull Request -
State: closed - Opened by dhruvarya-db 4 months ago
#3415 - [Hudi] Refactor tests
Pull Request -
State: closed - Opened by anniewang-db 4 months ago
#3414 - [Spark][UniForm] Add test suite/utils for enable UniForm without rewrite
Pull Request -
State: closed - Opened by xzhseh 4 months ago
#3413 - [BUG] Merge multiple match check is too strict
Issue -
State: open - Opened by clee704 4 months ago
Labels: bug
#3412 - [Spark] Fix the semantic of `shouldRewriteToBeIcebergCompatible` in REORG UPGRADE UNIFORM
Pull Request -
State: closed - Opened by xzhseh 4 months ago
#3411 - Match table exhaustively for ConvertToDelta to avoid scala.MatchError
Pull Request -
State: closed - Opened by mingdai-db 4 months ago
#3410 - Revert "[Spark] Add custom not matched for insert clauses expr (#3405)"
Pull Request -
State: closed - Opened by leonwind-db 4 months ago
#3409 - [BUG] java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.TableIdentifier.copy(Ljava/lang/String;Lscala/Option;)Lorg/apache/spark/sql/catalyst/TableIdentifier
Issue -
State: closed - Opened by Kosta404 4 months ago
- 1 comment
Labels: bug
#3408 - [Kernel] Add exception principles for Kernel to solidify the rules for our exception framework
Pull Request -
State: closed - Opened by allisonport-db 4 months ago
- 1 comment
#3407 - [Kernel] Wrap calls into the engine implementation with `KernelEngineException`
Pull Request -
State: closed - Opened by allisonport-db 4 months ago
#3406 - [Feature Request] Support Coordinated Commits in Delta Kernel
Issue -
State: open - Opened by EstherBear 4 months ago
Labels: enhancement
#3405 - [Spark] Add custom not matched for insert clauses expr
Pull Request -
State: closed - Opened by leonwind-db 4 months ago
#3404 - [Spark] Python DeltaTableBuilder API for Identity Columns
Pull Request -
State: closed - Opened by zhipengmao-db 4 months ago
#3403 - [QUESTION] support of "parquet io cache"
Issue -
State: open - Opened by VladimirPchelko 4 months ago
#3402 - [Spark] Minor refactor in Delta Protocol Transition Suite
Pull Request -
State: closed - Opened by andreaschat-db 4 months ago
#3401 - [doc] Clarify nullability for ALTER TABLE ADD COLUMNS
Pull Request -
State: open - Opened by li-boxuan 4 months ago
#3400 - [Kernel] Add parsing support for coordinated commits Map type table properties
Pull Request -
State: closed - Opened by EstherBear 4 months ago
#3399 - [UNIFORM] Remove unnecessary iceberg patch and disable cleanup of files in expire snapshots via cleanExpiredFiles API
Pull Request -
State: closed - Opened by amogh-jahagirdar 4 months ago
- 2 comments
#3398 - [Protocol]: Allow storing UTC adjusted timestamp partition values
Pull Request -
State: closed - Opened by amogh-jahagirdar 4 months ago
- 1 comment
#3397 - Assert schema in `DeltaParquetFileFormatSuite`
Pull Request -
State: open - Opened by Fokko 4 months ago
#3396 - [Kernel] Add default coordinated commits handler implementation
Pull Request -
State: closed - Opened by EstherBear 4 months ago
#3394 - [BUG][Spark] Merge generate ONE HUGE file
Issue -
State: open - Opened by davira 4 months ago
Labels: bug
#3393 - [Kernel] Add column mapping metadata update functionality
Pull Request -
State: open - Opened by nastra 4 months ago
- 2 comments
#3392 - [Spark] Add Scala `clone`, `cloneAtVersion`, and `cloneAtTimestamp` API
Pull Request -
State: closed - Opened by Kimahriman 4 months ago
- 7 comments
#3391 - [Feature Request][Spark] Add Scala API for cloning
Issue -
State: closed - Opened by Kimahriman 4 months ago
Labels: enhancement
#3390 - [Kernel] Update the Kernel write with coordinated commit support
Pull Request -
State: open - Opened by EstherBear 4 months ago
#3389 - General question: removing optimized/deleted data files without VACUUM
Issue -
State: closed - Opened by keenanwells-tatari 4 months ago
- 4 comments
#3388 - Move OutputTimestampType to `DeltaSQLConf`
Pull Request -
State: closed - Opened by Fokko 4 months ago
#3387 - [SPARK] Add Integration Test in `MergeIntoMaterializeSourceSuite`
Pull Request -
State: closed - Opened by mingkangli-db 4 months ago
#3386 - [Spark] Increase replication level in MERGE source materiazliation after first retry
Pull Request -
State: closed - Opened by johanl-db 4 months ago
#3385 - Formatting
Pull Request -
State: closed - Opened by zhipengmao-db 4 months ago
#3384 - [Feature Request][Kernel] Ensure writers use the column-mapping transformed physical schema
Issue -
State: open - Opened by raveeram-db 4 months ago
- 2 comments
Labels: enhancement, kernel
#3383 - [Feature Request][Kernel] Add column mapping metadata update functionality
Issue -
State: open - Opened by raveeram-db 4 months ago
Labels: enhancement
#3382 - [Spark][WIP] Fix moving between compatibility versions in REORG TABLE (UPGRADE UNIFORM)
Pull Request -
State: open - Opened by johanl-db 4 months ago
#3381 - [Kernel] Update the Kernel read with coordinated commit support
Pull Request -
State: closed - Opened by EstherBear 4 months ago
#3380 - [Spark] Make TrackingCommitCoordinatorClient more generic
Pull Request -
State: closed - Opened by dhruvarya-db 4 months ago
#3379 - [Spark] Enable UniForm Without Rewrite
Pull Request -
State: closed - Opened by xzhseh 4 months ago
#3378 - [Protocol, Spark] UTC normalize timestamp partition values
Pull Request -
State: closed - Opened by amogh-jahagirdar 4 months ago
- 1 comment
#3377 - [Storage][Kernel] Add InMemoryCommitCoordinator
Pull Request -
State: closed - Opened by EstherBear 4 months ago
- 1 comment
#3376 - [Spark] Use DeltaSQLTestUtils in more test suites
Pull Request -
State: closed - Opened by johanl-db 4 months ago
#3375 - [BUG]write_delta({'custom_metadata':str}) cannot be converted. str to pyDict error (0.18.2_DeltaPython/Windows10)
Issue -
State: open - Opened by starzar 4 months ago
Labels: bug
#3374 - [Spark] Only attempt parsing partition path into different types if type inference is enabled
Pull Request -
State: closed - Opened by amogh-jahagirdar 4 months ago
#3373 - [Spark] Write INT64 by default for Timestamps
Pull Request -
State: closed - Opened by Fokko 4 months ago
- 1 comment
#3372 - [BUG]
Issue -
State: open - Opened by Crackedperson 4 months ago
- 2 comments
Labels: bug
#3371 - [Spark] Remove dropped columns when running REORG PURGE
Pull Request -
State: closed - Opened by xzhseh 4 months ago
- 1 comment
#3370 - [Kernel] Add coordinated commits interfaces and table properties
Pull Request -
State: closed - Opened by EstherBear 4 months ago
Labels: kernel
#3369 - [Spark] Remove tracking usageRecords in runFunctionsWithOrderingFromObserver
Pull Request -
State: closed - Opened by longvu-db 4 months ago
#3368 - [Spark] Expose uncertainty in isDeltaTable resolution via exceptions
Pull Request -
State: closed - Opened by larsk-db 4 months ago
#3367 - Use Delta table stats if time travel is the latest version
Pull Request -
State: closed - Opened by minyyy 4 months ago
#3366 - [Spark] Batch resolve DeltaMergeAction in ResolveMergeInto
Pull Request -
State: closed - Opened by c27kwan 4 months ago
- 1 comment
#3365 - [Spark] Remove timeout source from withTempDir in Delta tests
Pull Request -
State: closed - Opened by johanl-db 4 months ago
#3364 - Update sbt to 1.10.1
Pull Request -
State: open - Opened by nastra 4 months ago
#3363 - [Flink] Bump Flink to 1.17.2
Pull Request -
State: open - Opened by nastra 4 months ago
- 1 comment
#3362 - [UniForm] Report accurate type when checking Iceberg compatible types
Pull Request -
State: closed - Opened by harperjiang 4 months ago