apache/incubator-xtable issues and pull requests

#633 - [590] Add Iceberg HMS Catalog Sync implementation

Pull Request - State: open - Opened by kroushan-nit 8 days ago

#632 - [590] Add Iceberg Glue Catalog Sync implementation

Pull Request - State: open - Opened by kroushan-nit 8 days ago

#631 - Add RFC for deletion vector conversion support in XTable

Issue - State: open - Opened by ashvina 9 days ago

#630 - [Bugfix] Populate table name from the identifier in Iceberg conversion

Pull Request - State: open - Opened by jalpan-randeri 10 days ago

#629 - [DRAFT] upgrade to Hudi 0.15.0

Pull Request - State: open - Opened by the-other-tim-brown 10 days ago

#629 - [DRAFT] upgrade to Hudi 0.15.0

Pull Request - State: open - Opened by the-other-tim-brown 10 days ago

#628 - Update GMeet link and add today's recording

Pull Request - State: closed - Opened by vinishjail97 10 days ago

#628 - Update GMeet link and add today's recording

Pull Request - State: closed - Opened by vinishjail97 10 days ago

#627 - Extract Delta Lake deletion vectors

Pull Request - State: open - Opened by ashvina 15 days ago - 1 comment

#626 - Updated the New Community Page

Pull Request - State: closed - Opened by dipankarmazumdar 16 days ago

#625 - Add community sync page for XTable

Pull Request - State: closed - Opened by vinishjail97 20 days ago

#624 - Wrong conversion from Delta to Iceberg when Delta table is enabled column mapping

Issue - State: open - Opened by emilie-wang 20 days ago - 5 comments
Labels: bug

#623 - Delta source: add record count for DataFile

Pull Request - State: open - Opened by emilie-wang 22 days ago

#621 - Add custom iceberg metadata cleaner

Pull Request - State: open - Opened by vamsikarnika 29 days ago

#620 - [619] Maintenance: Update dependencies, fix test class names

Pull Request - State: closed - Opened by the-other-tim-brown about 1 month ago

#619 - Test Naming Updates and maintanence

Issue - State: closed - Opened by the-other-tim-brown about 1 month ago

#618 - [DRAFT] Restructure Repo for Table Format specific modules

Pull Request - State: open - Opened by the-other-tim-brown about 1 month ago

#617 - [608] Ensure column stats for decimal fields have proper scale set

Pull Request - State: closed - Opened by the-other-tim-brown about 1 month ago

#616 - [615] Add Iceberg stats when reading snapshot

Pull Request - State: closed - Opened by the-other-tim-brown about 1 month ago

#615 - Iceberg source does not pull column stats with snapshot sync

Issue - State: closed - Opened by the-other-tim-brown about 1 month ago
Labels: bug

#614 - [590] Hadoop and AWS sdk version upgrade

Pull Request - State: closed - Opened by kroushan-nit about 1 month ago

#613 - Refactor ConversionSourceProvider to TableStateProvider

Pull Request - State: closed - Opened by vinishjail97 about 1 month ago

#612 - [611] RFC: Module Restructuring

Pull Request - State: open - Opened by the-other-tim-brown about 1 month ago - 1 comment

#611 - Allow users to only include dependencies for relevant table formats during conversion

Issue - State: open - Opened by the-other-tim-brown about 1 month ago

#610 - [590] Add RFC template for XTable

Pull Request - State: closed - Opened by vinishjail97 about 1 month ago

#608 - Incorrect stats getting populated for a Decimal column while converting DeltaTable to IcebergTable using XTable

Issue - State: open - Opened by Prajwaltr011 about 2 months ago - 7 comments
Labels: bug

#608 - Incorrect stats getting populated for a Decimal column while converting DeltaTable to IcebergTable using XTable

Issue - State: open - Opened by Prajwaltr011 about 2 months ago - 2 comments
Labels: bug

#606 - Add delta hms sync

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago

#606 - Add delta hms sync

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago

#605 - [590] Add RFC for XCatalogSync - Synchronize tables across catalogs

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago - 2 comments

#604 - [590] Add RFC template for XTable

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago - 1 comment

#603 - [590] Add interfaces for CatalogSyncClient and CatalogSync

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago

#602 - Normalize basePath in targetTables in ConversionController

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago

#601 - Normalize basePath in targetTables in ConversionController

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago - 1 comment

#600 - [590] Add Iceberg HMS Catalog Sync implementation

Pull Request - State: closed - Opened by kroushan-nit about 2 months ago

#599 - [590] Add Iceberg Glue Catalog Sync implementation

Pull Request - State: closed - Opened by kroushan-nit about 2 months ago

#598 - Add interface for CatalogSyncClient and CatalogSync

Pull Request - State: closed - Opened by kroushan-nit about 2 months ago

#597 - [590] Add syncCatalogs in ConversionController

Pull Request - State: closed - Opened by vinishjail97 about 2 months ago

#596 - Fix commit log parsing of Delta tables with delete vector

Pull Request - State: closed - Opened by ashvina about 2 months ago

#595 - Parsing of source Delta table with delete vectors fails or is incorrect

Issue - State: closed - Opened by ashvina about 2 months ago

#594 - Add an option to continuously sync table metadata with the RunSync tool

Issue - State: open - Opened by the-other-tim-brown about 2 months ago

#593 - [594] Support continuous conversion with the RunSync tool

Pull Request - State: open - Opened by the-other-tim-brown 2 months ago

#592 - Sync parquet to other file formats

Pull Request - State: open - Opened by sudhar91 2 months ago - 2 comments

#591 - [590] Add RunCatalogSync utility for synchronizing tables across catalogs

Pull Request - State: closed - Opened by vinishjail97 2 months ago - 10 comments

#590 - Sync table formats metadata to multiple catalogs.

Issue - State: open - Opened by vinishjail97 2 months ago - 2 comments
Labels: enhancement

#589 - Execute correct delete operation in delta tests

Pull Request - State: closed - Opened by ashvina 2 months ago - 1 comment

#588 - Delta table delete rows tests incorrectly uses merge operation

Issue - State: closed - Opened by ashvina 2 months ago - 1 comment
Labels: bug

#587 - Site content is not deployed due to missing .asf.yaml file

Pull Request - State: closed - Opened by zabetak 2 months ago

#586 - Issue with Metadata Reconciliation Between Iceberg and Delta Tables During Snapshot Updates

Issue - State: open - Opened by MrDerecho 2 months ago - 1 comment
Labels: bug

#585 - Add 2 New Community Blogs to the Apache XTable Blogs section

Pull Request - State: closed - Opened by dipankarmazumdar 2 months ago

#582 - Support for Iceberg update and deletion vectors

Issue - State: closed - Opened by nicor88 3 months ago - 1 comment

#581 - Unable to read the Iceberg table in Athena that was converted from Hudi to Iceberg format using XTable

Issue - State: open - Opened by rangareddy 3 months ago - 2 comments
Labels: bug

#580 - [DOCS] Remove info on snowflake public preview for Iceberg

Pull Request - State: closed - Opened by sagarlakshmipathy 3 months ago

#579 - Remove public preview info on SF Iceberg support

Issue - State: closed - Opened by sagarlakshmipathy 3 months ago - 1 comment
Labels: bug

#577 - [551] Try enabling keep_files as false in GH action for downloads

Pull Request - State: closed - Opened by vinishjail97 3 months ago

#576 - [551] Add downloads page for 0.2.0-incubating release

Pull Request - State: closed - Opened by vinishjail97 3 months ago

#575 - Iceberg and Delta target: sync schema field comments

Pull Request - State: closed - Opened by emilie-wang 3 months ago - 1 comment

#572 - [551] Create separate LICENSE and NOTICE files for xtable-hudi-support-extensions

Pull Request - State: closed - Opened by vinishjail97 3 months ago - 5 comments

#570 - [536] Exclude xtable-hudi-support-extensions from mvn deploy

Pull Request - State: closed - Opened by vinishjail97 3 months ago - 3 comments

#569 - [Enhancement] Support restore/rollback sync during conversion (1/2)

Pull Request - State: open - Opened by danielhumanmod 3 months ago - 5 comments

#568 - Update `xtable-hadoop-defaults.xml` reference

Pull Request - State: closed - Opened by emmanuel-ferdman 3 months ago - 1 comment

#567 - [551] Include slf4j in LICENSE file

Pull Request - State: closed - Opened by vinishjail97 4 months ago - 7 comments

#566 - [551] Remove dependencies in LICENSE and NOTICE files based on feedback in LEGAL-684

Pull Request - State: closed - Opened by vinishjail97 4 months ago - 2 comments

#564 - Add scopes to all pom files for clarity

Issue - State: closed - Opened by the-other-tim-brown 4 months ago

#563 - [564] mirror parent dependency scopes in child pom files

Pull Request - State: closed - Opened by the-other-tim-brown 4 months ago

#562 - [561] Add timeout to Github Action

Pull Request - State: closed - Opened by the-other-tim-brown 4 months ago

#561 - [CI] Set timeout on Github actions

Issue - State: closed - Opened by the-other-tim-brown 4 months ago
Labels: bug

#560 - Upgrade protobuf due to CVE-2024-7254

Issue - State: closed - Opened by the-other-tim-brown 4 months ago

#559 - use avro 1.11.4 due to CVE-2024-47561

Pull Request - State: closed - Opened by pjfanning 4 months ago

#558 - use avro 1.11.4 due to CVE-2024-47561

Issue - State: closed - Opened by pjfanning 4 months ago - 1 comment
Labels: bug

#557 - [560] Increment Protobuf version due to vulnerability

Pull Request - State: closed - Opened by the-other-tim-brown 4 months ago

#556 - Bump com.google.protobuf:protobuf-java from 3.21.9 to 3.25.5

Pull Request - State: closed - Opened by dependabot[bot] 4 months ago - 1 comment
Labels: dependencies, java

#555 - mirror parent dependency scopes in child poms

Pull Request - State: closed - Opened by the-other-tim-brown 4 months ago

#554 - Design a system which consumes columnar file notifications from HDFS/cloud storage and generates delta, hudi and iceberg metadata

Issue - State: open - Opened by vinishjail97 4 months ago - 2 comments
Labels: enhancement

#553 - Implement a utility tool for syncing parquet files to all three formats delta, hudi, iceberg using file listing

Issue - State: open - Opened by vinishjail97 4 months ago - 6 comments
Labels: enhancement

#552 - [551] Exclude xtable-utilities from release guide

Pull Request - State: closed - Opened by vinishjail97 4 months ago

#551 - XTable 2nd release

Issue - State: closed - Opened by vinishjail97 4 months ago - 3 comments
Labels: infra

#550 - add support for converting traditional hive tables to iceberg/delta/hudi

Issue - State: open - Opened by djouallah 4 months ago - 13 comments
Labels: enhancement

#549 - [DOCS] Update catalog docs to show automatic catalog syncs to Snowflake and Glue

Pull Request - State: open - Opened by sagarlakshmipathy 4 months ago - 1 comment

#548 - Improve catalog sync docs to do similar syncs in Glue and Snowflake as BLMS

Issue - State: open - Opened by sagarlakshmipathy 4 months ago
Labels: documentation

#547 - [546] Update Lombok Dependency Scope in Project

Pull Request - State: closed - Opened by vamsikarnika 4 months ago

#546 - Update Lombok Dependency Scope in Project

Issue - State: closed - Opened by vamsikarnika 4 months ago

#545 - Polaris catalog sync failing with Delegate access to table with user-specified write location is temporarily not supported.

Issue - State: closed - Opened by sagarlakshmipathy 5 months ago - 4 comments
Labels: bug

#544 - [529] Build xtable with scala version(s)

Pull Request - State: closed - Opened by rangareddy 5 months ago - 3 comments

#543 - Enhance UUID Compatibility in Iceberg to Hudi Conversion

Issue - State: open - Opened by danielhumanmod 5 months ago - 2 comments

#542 - update import statements match Delta version upgrade in PR 349

Pull Request - State: closed - Opened by zhen-d 5 months ago

#541 - [536] Update LICENSE and NOTICE files

Pull Request - State: closed - Opened by vinishjail97 5 months ago - 2 comments

#540 - [536] Exclude xtable-utilities from mvn deploy

Pull Request - State: closed - Opened by vinishjail97 5 months ago

#539 - [532] Add DISCLAIMER file to META-INF folder in jars

Pull Request - State: closed - Opened by rangareddy 5 months ago - 5 comments

#538 - Reduce size of utilities bundled jar

Pull Request - State: open - Opened by vamsikarnika 5 months ago - 4 comments

#537 - [530] xtable-core pom has a hardcoded scala version for jackson-module-scala

Pull Request - State: closed - Opened by rangareddy 5 months ago

#536 - Review LICENSE files for xtable based on feedback provided in [email protected]

Issue - State: open - Opened by vinishjail97 5 months ago - 2 comments
Labels: release-blocker-0.3.0

#535 - Set keep_files as false in GH action for site deploy to remove lingering pages

Pull Request - State: closed - Opened by vinishjail97 5 months ago

#533 - [531] xtable poms are missing license details.

Pull Request - State: closed - Opened by rangareddy 5 months ago - 2 comments

#532 - add DISCLAIMER to META-INF in jars

Issue - State: closed - Opened by pjfanning 5 months ago - 3 comments
Labels: release-blocker 0.2.0

#531 - xtable poms are missing license details

Issue - State: closed - Opened by pjfanning 5 months ago - 2 comments
Labels: release-blocker 0.2.0

#530 - xtable-core pom has a hardcoded scala version for jackson-module-scala

Issue - State: closed - Opened by pjfanning 5 months ago - 2 comments
Labels: release-blocker 0.2.0

#529 - xtable has scala jar dependencies - should you suffix your jar names with the scala version?

Issue - State: closed - Opened by pjfanning 5 months ago - 4 comments
Labels: release-blocker 0.2.0

#528 - Refactor RunSync Class for Improved Modularity and Reusability

Issue - State: open - Opened by rangareddy 5 months ago - 4 comments
Labels: enhancement

#526 - Fix the edge case when handling non numeric values of double type in delta stats

Pull Request - State: closed - Opened by emilie-wang 5 months ago - 6 comments

GitHub / apache/incubator-xtable issues and pull requests