apache/hudi issues and pull requests

#8581 - Hudi reads failing on upgrade to Hudi 0.12.2 from Hudi 0.11.1

Issue - State: closed - Opened by SabyasachiDasTR over 1 year ago - 4 comments
Labels: spark, version-compatibility

#8581 - Hudi reads failing on upgrade to Hudi 0.12.2 from Hudi 0.11.1

Issue - State: closed - Opened by SabyasachiDasTR over 1 year ago - 4 comments
Labels: spark, version-compatibility

#8581 - Hudi reads failing on upgrade to Hudi 0.12.2 from Hudi 0.11.1

Issue - State: closed - Opened by SabyasachiDasTR over 1 year ago - 4 comments
Labels: spark, version-compatibility

#8579 - [MINOR] Added docs for gotchas when using PartialUpdateAvroPayload

Pull Request - State: closed - Opened by voonhous over 1 year ago - 7 comments

#8574 - [HUDI-6139] Add support for Transformer schema validation in DeltaStreamer

Pull Request - State: open - Opened by lokeshj1703 over 1 year ago - 3 comments

#8574 - [HUDI-6139] Add support for Transformer schema validation in DeltaStreamer

Pull Request - State: open - Opened by lokeshj1703 over 1 year ago - 3 comments

#8568 - [HUDI-6134] Prevent two clean run concurrently in flink

Pull Request - State: closed - Opened by hbgstc123 over 1 year ago - 5 comments

#8565 - [SUPPORT] Hudi Bootstrap with METADATA_ONLY with Hive Sync Fails on EMR Serverlkess 6.10

Issue - State: closed - Opened by soumilshah1995 over 1 year ago
Labels: meta-sync, aws-support, priority:major, bootstrap

#8563 - [HUDI-6133](hudi-metaserver) Eliminate one deletion operation if state is not COMPLETED

Pull Request - State: open - Opened by littleeleventhwolf over 1 year ago - 2 comments
Labels: priority:major, metadata, release-0.14.0, meta-server

#8563 - [HUDI-6133](hudi-metaserver) Eliminate one deletion operation if state is not COMPLETED

Pull Request - State: open - Opened by littleeleventhwolf over 1 year ago - 2 comments
Labels: priority:major, metadata, release-0.14.0, meta-server

#8546 - [MINOR] Add log in flink compact/cluster commit sink for troubleshoot…

Pull Request - State: closed - Opened by hbgstc123 over 1 year ago - 4 comments
Labels: table-service, size:S

#8537 - [HUDI-6122] Unify options in call procedure

Pull Request - State: closed - Opened by Zouxxyy over 1 year ago - 2 comments
Labels: spark, utilities

#8537 - [HUDI-6122] Unify options in call procedure

Pull Request - State: closed - Opened by Zouxxyy over 1 year ago - 2 comments
Labels: spark, utilities

#8537 - [HUDI-6122] Unify options in call procedure

Pull Request - State: closed - Opened by Zouxxyy over 1 year ago - 2 comments
Labels: spark, utilities

#8534 - [MINOR] Fix misleading permitted write operation value

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment

#8532 - [SUPPORT]org.apache.spark.shuffle.MetadataFetchFailedException: Missing an output location for shuffle 11 partition 1

Issue - State: open - Opened by gtwuser over 1 year ago - 7 comments
Labels: priority:major, spark

#8526 - [HUDI-6116] Optimize log block reading by removing seeks to check corrupted blocks.

Pull Request - State: open - Opened by prashantwason over 1 year ago - 2 comments
Labels: performance, priority:critical, reader-core, release-0.14.0

#8520 - [HUDI-6115] Hardening expectation of corruptRecordColumn in ChainedTransformer.

Pull Request - State: open - Opened by harsh1231 over 1 year ago - 4 comments
Labels: priority:critical, release-0.14.0

#8520 - [HUDI-6115] Hardening expectation of corruptRecordColumn in ChainedTransformer.

Pull Request - State: open - Opened by harsh1231 over 1 year ago - 4 comments
Labels: priority:critical, release-0.14.0

#8520 - [HUDI-6115] Hardening expectation of corruptRecordColumn in ChainedTransformer.

Pull Request - State: open - Opened by harsh1231 over 1 year ago - 4 comments
Labels: priority:critical, release-0.14.0

#8520 - [HUDI-6115] Hardening expectation of corruptRecordColumn in ChainedTransformer.

Pull Request - State: open - Opened by harsh1231 over 1 year ago - 4 comments
Labels: priority:critical, release-0.14.0

#8519 - [SUPPORT] Deltastreamer AvroDeserializer failing with java.lang.NullPointerException

Issue - State: open - Opened by sydneyhoran over 1 year ago - 27 comments
Labels: deltastreamer

#8506 - [HUDI-6104] Clean deleted partition with clean policy

Pull Request - State: open - Opened by hbgstc123 over 1 year ago - 3 comments
Labels: writer-core, table-service, release-0.14.0

#8505 - [HUDI-6106] Spark offline compaction/Clustering Job will do clean like Flink job

Pull Request - State: closed - Opened by zhuanshenbsj1 over 1 year ago - 8 comments
Labels: spark, table-service

#8505 - [HUDI-6106] Spark offline compaction/Clustering Job will do clean like Flink job

Pull Request - State: closed - Opened by zhuanshenbsj1 over 1 year ago - 8 comments
Labels: spark, table-service

#8505 - [HUDI-6106] Spark offline compaction/Clustering Job will do clean like Flink job

Pull Request - State: closed - Opened by zhuanshenbsj1 over 1 year ago - 8 comments
Labels: spark, table-service

#8501 - [HUDI-6103] Validate required columns when fetching required positions

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: flink, streaming

#8501 - [HUDI-6103] Validate required columns when fetching required positions

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: flink, streaming

#8501 - [HUDI-6103] Validate required columns when fetching required positions

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: flink, streaming

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8499 - [SUPPORT] Support partial insert in merge into command

Issue - State: closed - Opened by jhchee over 1 year ago - 4 comments
Labels: spark, writer-core, feature-enquiry, spark-sql

#8493 - [HUDI-6098] Use bulk insert prepped for the initial write into MDT.

Pull Request - State: closed - Opened by prashantwason over 1 year ago - 8 comments
Labels: priority:critical, spark, flink, metadata, release-0.14.0

#8492 - [HUDI-6096] Update table name in hoodie.properties from the write config when it is changed.

Pull Request - State: closed - Opened by prashantwason over 1 year ago - 6 comments
Labels: priority:minor, configs, release-0.14.0

#8489 - [HUDI-6094] make utilities kafka send call from async to sync

Pull Request - State: closed - Opened by dubin555 over 1 year ago - 7 comments

#8487 - [HUDI-6093] Use the correct partitionToReplacedFileIds during commit.

Pull Request - State: open - Opened by prashantwason over 1 year ago - 7 comments
Labels: priority:critical, release-0.14.0

#8478 - [HUDI-6086] Improve HiveSchemaUtil#generateCreateDDL With StringBuilder

Pull Request - State: open - Opened by slfan1989 over 1 year ago - 8 comments
Labels: priority:minor, code-refactor

#8476 - [HUDI-6087] Fix flink streaming source savepoint instant

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment
Labels: flink, streaming, incremental-etl

#8460 - [HUDI-6079] Improve the code of HMSDDLExecutor, HiveQueryDDLExecutor.

Pull Request - State: open - Opened by slfan1989 over 1 year ago - 2 comments
Labels: size:L

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8448 - [HUDI-6069] Fix record key range fetching from the metadata table in Bloom Index

Pull Request - State: closed - Opened by chestnutqiang over 1 year ago - 2 comments
Labels: release-1.0.0, size:XS

#8445 - [HUDI-3088] Use Spark 3.2 as default Spark version

Pull Request - State: open - Opened by xushiyan over 1 year ago - 1 comment
Labels: dependencies, priority:critical, release-0.14.0

#8440 - [DO NOT MERGE] run gh actions with java 17

Pull Request - State: closed - Opened by jonvex over 1 year ago - 1 comment

#8439 - [DO NOT MERGE] run tests with java 11

Pull Request - State: closed - Opened by jonvex over 1 year ago - 1 comment

#8430 - [HUDI-6060] Added a config to backup instants before deletion during rollbacks and restores.

Pull Request - State: open - Opened by prashantwason over 1 year ago - 4 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0, debugging

#8418 - [HUDI-6052] Standardise TIMESTAMP(6) format when writing to Parquet f…

Pull Request - State: closed - Opened by voonhous over 1 year ago - 9 comments
Labels: schema-and-data-types, flink-sql, version-compatibility

#8400 - [SUPPORT] Hudi Offline Compaction in EMR Serverless 6.10 for YouTube Video

Issue - State: closed - Opened by soumilshah1995 over 1 year ago - 27 comments
Labels: aws-support, priority:major, table-service

#8399 - [HUDI-4630] Add transformer capability to individual feeds in MultiTableDeltaStreamer

Pull Request - State: closed - Opened by yesemsanthoshkumar over 1 year ago - 7 comments

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8389 - [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

Pull Request - State: closed - Opened by nsivabalan over 1 year ago - 2 comments
Labels: release-0.14.0

#8389 - [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

Pull Request - State: closed - Opened by nsivabalan over 1 year ago - 2 comments
Labels: release-0.14.0

#8387 - [HUDI-6041] add `options` input to Bootstrap Procedure for passing hudi properties

Pull Request - State: open - Opened by lvyanquan over 1 year ago - 4 comments

#8349 - [HUDI-6012] Delete base path when failed to run bootstrap procedure

Pull Request - State: closed - Opened by lvyanquan over 1 year ago - 2 comments

#8332 - [SUPPORT] Spark insert overwrite in partition table causes executors OOM.

Issue - State: closed - Opened by HuangFru over 1 year ago - 20 comments
Labels: priority:major, spark, writer-core