Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apache/hudi issues and pull requests

#8476 - [HUDI-6087] Fix flink streaming source savepoint instant

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment
Labels: flink, streaming, incremental-etl

#8460 - [HUDI-6079] Improve the code of HMSDDLExecutor, HiveQueryDDLExecutor.

Pull Request - State: open - Opened by slfan1989 over 1 year ago - 2 comments
Labels: size:L

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8452 - [HUDI-6077] Add more partition push down filters

Pull Request - State: open - Opened by boneanxs over 1 year ago - 11 comments
Labels: big-needle-movers, release-0.14.0

#8448 - [HUDI-6069] Fix record key range fetching from the metadata table in Bloom Index

Pull Request - State: closed - Opened by chestnutqiang over 1 year ago - 2 comments
Labels: release-1.0.0, size:XS

#8445 - [HUDI-3088] Use Spark 3.2 as default Spark version

Pull Request - State: open - Opened by xushiyan over 1 year ago - 1 comment
Labels: dependencies, priority:critical, release-0.14.0

#8440 - [DO NOT MERGE] run gh actions with java 17

Pull Request - State: closed - Opened by jonvex over 1 year ago - 1 comment

#8439 - [DO NOT MERGE] run tests with java 11

Pull Request - State: closed - Opened by jonvex over 1 year ago - 1 comment

#8430 - [HUDI-6060] Added a config to backup instants before deletion during rollbacks and restores.

Pull Request - State: open - Opened by prashantwason over 1 year ago - 4 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0, debugging

#8418 - [HUDI-6052] Standardise TIMESTAMP(6) format when writing to Parquet f…

Pull Request - State: closed - Opened by voonhous over 1 year ago - 9 comments
Labels: schema-and-data-types, flink-sql, version-compatibility

#8400 - [SUPPORT] Hudi Offline Compaction in EMR Serverless 6.10 for YouTube Video

Issue - State: closed - Opened by soumilshah1995 over 1 year ago - 27 comments
Labels: aws-support, priority:major, table-service

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8394 - [HUDI-6085] Eliminate cleaning tasks for flink mor table if online async compaciton is disabled

Pull Request - State: open - Opened by zhuanshenbsj1 over 1 year ago - 1 comment
Labels: flink, table-service, streaming

#8389 - [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

Pull Request - State: closed - Opened by nsivabalan over 1 year ago - 2 comments
Labels: release-0.14.0

#8389 - [HUDI-5514] Improving usability/performance with out of box default for append only use-cases

Pull Request - State: closed - Opened by nsivabalan over 1 year ago - 2 comments
Labels: release-0.14.0

#8387 - [HUDI-6041] add `options` input to Bootstrap Procedure for passing hudi properties

Pull Request - State: open - Opened by lvyanquan over 1 year ago - 4 comments

#8349 - [HUDI-6012] Delete base path when failed to run bootstrap procedure

Pull Request - State: closed - Opened by lvyanquan over 1 year ago - 2 comments

#8332 - [SUPPORT] Spark insert overwrite in partition table causes executors OOM.

Issue - State: closed - Opened by HuangFru over 1 year ago - 20 comments
Labels: priority:major, spark, writer-core

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8325 - [SUPPORT] spark read hudi error: Unable to instantiate HFileBootstrapIndex

Issue - State: closed - Opened by hbgstc123 over 1 year ago - 11 comments
Labels: metadata, version-compatibility

#8303 - [HUDI-5998] Speed up reads from bootstrapped tables in spark

Pull Request - State: open - Opened by jonvex over 1 year ago - 4 comments
Labels: bootstrap

#8301 - [HUDI-5988] Add a param, Implement a full partition sync operation wh…

Pull Request - State: open - Opened by weimingdiit over 1 year ago - 6 comments

#8301 - [HUDI-5988] Add a param, Implement a full partition sync operation wh…

Pull Request - State: open - Opened by weimingdiit over 1 year ago - 6 comments

#8265 - [SUPPORT] Flink Table planner not loading problem

Issue - State: open - Opened by huyuanfeng2018 over 1 year ago - 20 comments
Labels: priority:blocker, flink, release-0.14.0, clazz-not-found

#8199 - [SUPPORT] OOM during a Sync/Async clean operation

Issue - State: open - Opened by gudladona over 1 year ago - 6 comments
Labels: performance, priority:critical, table-service

#8190 - [HUDI-5936] Fix serialization problem when FileStatus is not serializable

Pull Request - State: open - Opened by CTTY over 1 year ago - 5 comments
Labels: aws-support, spark, writer-core, test-coverage

#8174 - [HUDI-5688] Fixing read of an empty table

Pull Request - State: open - Opened by nsivabalan over 1 year ago - 2 comments
Labels: priority:major, reader-core

#8159 - [SUPPORT] - Debezium PostgreSQL

Issue - State: open - Opened by lenhardtx over 1 year ago - 4 comments
Labels: aws-support, deltastreamer, spark

#8147 - [SUPPORT] Missing dependency on hive-exec (core)

Issue - State: closed - Opened by kkrugler over 1 year ago - 14 comments
Labels: flink, clazz-conflict

#8144 - [SUPPORT]Unable to connect to an s3 hudi table

Issue - State: open - Opened by peter-mccabe over 1 year ago - 4 comments
Labels: aws-support, on-call-triaged

#8144 - [SUPPORT]Unable to connect to an s3 hudi table

Issue - State: open - Opened by peter-mccabe over 1 year ago - 4 comments
Labels: aws-support, on-call-triaged

#8144 - [SUPPORT]Unable to connect to an s3 hudi table

Issue - State: open - Opened by peter-mccabe over 1 year ago - 4 comments
Labels: aws-support, on-call-triaged

#8144 - [SUPPORT]Unable to connect to an s3 hudi table

Issue - State: open - Opened by peter-mccabe over 1 year ago - 4 comments
Labels: aws-support, on-call-triaged

#8144 - [SUPPORT]Unable to connect to an s3 hudi table

Issue - State: open - Opened by peter-mccabe over 1 year ago - 4 comments
Labels: aws-support, on-call-triaged

#8129 - [SUPPORT] hoodie.write.lock.dynamodb.partition_key not set automatically

Issue - State: open - Opened by Limess over 1 year ago - 2 comments
Labels: on-call-triaged

#8102 - [HUDI-5880] Support partition pruning for flink streaming source in runtime

Pull Request - State: closed - Opened by beyond1920 over 1 year ago - 9 comments
Labels: flink, streaming

#8082 - [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2

Pull Request - State: closed - Opened by rahil-c over 1 year ago - 28 comments
Labels: priority:blocker, spark-sql, release-0.13.1, version-compatibility

#8082 - [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2

Pull Request - State: closed - Opened by rahil-c over 1 year ago - 28 comments
Labels: priority:blocker, spark-sql, release-0.13.1, version-compatibility

#8082 - [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2

Pull Request - State: closed - Opened by rahil-c over 1 year ago - 28 comments
Labels: priority:blocker, spark-sql, release-0.13.1, version-compatibility

#8082 - [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2

Pull Request - State: closed - Opened by rahil-c over 1 year ago - 28 comments
Labels: priority:blocker, spark-sql, release-0.13.1, version-compatibility

#8076 - [HUDI-5884] Support bulk_insert for insert_overwrite and insert_overwrite_table

Pull Request - State: open - Opened by boneanxs over 1 year ago - 8 comments
Labels: big-needle-movers

#8066 - org.apache.hudi.exception.HoodieIOException: Could not check if hdfs:/user/hive/warehouse/xxx is a valid table

Issue - State: closed - Opened by wangzhongz over 1 year ago - 3 comments
Labels: meta-sync, priority:minor, on-call-triaged

#8062 - [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management

Pull Request - State: closed - Opened by stream2000 over 1 year ago - 16 comments
Labels: rfc

#8060 - [SUPPORT] An instant exception occurs when the flink job is restarted

Issue - State: closed - Opened by DavidZ1 over 1 year ago - 18 comments
Labels: writer-core, flink

#8049 - [HUDI-5849] Sync hudi configs to catalogs

Pull Request - State: closed - Opened by xushiyan over 1 year ago - 3 comments

#8035 - [WIP] Add a MOR table validation tool

Pull Request - State: closed - Opened by yihua over 1 year ago - 1 comment
Labels: cli, size:M

#8009 - [SUPPORT Hive Sync error : Could not sync using the meta sync class org.apache.hudi.hive.HiveSyncTool]

Issue - State: closed - Opened by aswin-mp over 1 year ago - 6 comments
Labels: meta-sync, aws-support, priority:major, release-0.14.0

#7998 - [HUDI-5824] Fix: do not combine if write operation is Upsert and COMBINE_BEFORE_UPSERT is false

Pull Request - State: closed - Opened by kazdy over 1 year ago - 7 comments
Labels: spark, writer-core

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7991 - Higher number of S3 HEAD requests, while writing data to S3.

Issue - State: open - Opened by jenu9417 over 1 year ago - 14 comments
Labels: aws-support, priority:critical, performance-regression

#7947 - [MINOR] DO NOT MERGE try reporting action

Pull Request - State: closed - Opened by jonvex over 1 year ago - 1 comment

#7939 - [MINOR] Updating Index page to include bucket and consistent hashing index

Pull Request - State: open - Opened by nsivabalan over 1 year ago - 1 comment
Labels: docs

#7913 - [HUDI-8235] Adding support for EPOCHMICROSECONDS in TimestampBasedAvroKeyGenerator

Pull Request - State: closed - Opened by sydneybeal over 1 year ago - 4 comments
Labels: size:S

#7887 - [MINOR] Description update for Flink Clustering and Compaction configuration

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment

#7887 - [MINOR] Description update for Flink Clustering and Compaction configuration

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment

#7887 - [MINOR] Description update for Flink Clustering and Compaction configuration

Pull Request - State: closed - Opened by voonhous over 1 year ago - 1 comment

#7865 - [HUDI-5710] Load all partitions in advance for clean when MDT is enabled

Pull Request - State: closed - Opened by zhangyue19921010 over 1 year ago - 3 comments
Labels: priority:critical, table-service

#7865 - [HUDI-5710] Load all partitions in advance for clean when MDT is enabled

Pull Request - State: closed - Opened by zhangyue19921010 over 1 year ago - 3 comments
Labels: priority:critical, table-service

#7865 - [HUDI-5710] Load all partitions in advance for clean when MDT is enabled

Pull Request - State: closed - Opened by zhangyue19921010 over 1 year ago - 3 comments
Labels: priority:critical, table-service

#7846 - [SUPPORT] Datasource incremental subsequent read same as first read

Issue - State: open - Opened by parisni over 1 year ago - 7 comments
Labels: priority:minor, spark, incremental-query

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7826 - [HUDI-5675] fix lazy clean schedule rollback on completed instant

Pull Request - State: open - Opened by stream2000 over 1 year ago - 17 comments
Labels: priority:critical, writer-core, table-service, release-0.14.0

#7730 - [SUPPORT] Hive Sync Tool parses timestamp field as bigint in Hive metastore

Issue - State: open - Opened by Ericliu249 over 1 year ago - 4 comments
Labels: meta-sync, priority:critical

#7719 - [HUDI-5584] When the table to be synchronized already exists in hive,…

Pull Request - State: open - Opened by LinMingQiang over 1 year ago - 5 comments
Labels: meta-sync, priority:critical, release-0.14.0

#7663 - [SUPPORT] ALTER TABLE DROP PARTITION DDL may cause data inconsistencies when table service actions are performed

Issue - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: priority:critical, spark-sql, release-0.14.0

#7663 - [SUPPORT] ALTER TABLE DROP PARTITION DDL may cause data inconsistencies when table service actions are performed

Issue - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: priority:critical, spark-sql, release-0.14.0

#7653 - [SUPPORT]java.util.ConcurrentModificationException: Cannot resolve conflicts for overlapping writes

Issue - State: open - Opened by maikouliujian over 1 year ago - 16 comments
Labels: priority:critical, multi-writer, release-0.14.0

#7653 - [SUPPORT]java.util.ConcurrentModificationException: Cannot resolve conflicts for overlapping writes

Issue - State: open - Opened by maikouliujian over 1 year ago - 16 comments
Labels: priority:critical, multi-writer, release-0.14.0

#7653 - [SUPPORT]java.util.ConcurrentModificationException: Cannot resolve conflicts for overlapping writes

Issue - State: open - Opened by maikouliujian over 1 year ago - 16 comments
Labels: priority:critical, multi-writer, release-0.14.0

#7652 - [HUDI-3526] Enhance Hudi Metrics

Pull Request - State: closed - Opened by kaori-seasons over 1 year ago - 4 comments
Labels: priority:major, metrics, size:L

#7646 - [HUDI-5542] Add javadocs for InternalSchemaManager

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: docs

#7646 - [HUDI-5542] Add javadocs for InternalSchemaManager

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: docs

#7646 - [HUDI-5542] Add javadocs for InternalSchemaManager

Pull Request - State: closed - Opened by voonhous over 1 year ago - 3 comments
Labels: docs

#7619 - [MINOR] Optimizing schema validation in Metadata table

Pull Request - State: closed - Opened by nsivabalan over 1 year ago - 2 comments
Labels: priority:critical, metadata, release-0.14.0

#7598 - [HUDI-5495] add some property to table config

Pull Request - State: open - Opened by XuQianJin-Stars over 1 year ago - 1 comment
Labels: size:M

#7572 - [HUDI-5483] Make RetryHelper more commonly usable

Pull Request - State: closed - Opened by minihippo almost 2 years ago - 4 comments
Labels: priority:critical

#7561 - [HUDI-5477] Optimize timeline loading in Hudi sync client

Pull Request - State: closed - Opened by yihua almost 2 years ago - 2 comments
Labels: meta-sync, priority:critical

#7539 - [SUPPORT]IllegalStateException: Trying to access closed classloader

Issue - State: open - Opened by hbgstc123 almost 2 years ago - 7 comments
Labels: priority:minor, flink

#7524 - [SUPPORT] Deltastreamer continuous mode failed async compaction

Issue - State: open - Opened by dyang108 almost 2 years ago - 3 comments
Labels: priority:major, hudistreamer, spark, table-service

#7503 - Failed to read schema while doing delete_partition operation

Issue - State: open - Opened by gaoshihang almost 2 years ago - 1 comment
Labels: meta-sync, priority:critical, writer-core, release-0.14.0

#7467 - [MINOR] fixed Flink's DataStream does not support creating managed table

Pull Request - State: closed - Opened by qifanlili almost 2 years ago - 4 comments
Labels: flink, size:XS