apache/hudi issues and pull requests

#10612 - [HUDI-7373] Make schema evolution doc and config correct

Pull Request - State: open - Opened by jonvex 10 months ago

#10611 - [HUDI-7373] revert config hoodie.write.handle.missing.cols.with.lossless.type.promotion

Pull Request - State: closed - Opened by jonvex 10 months ago - 2 comments

#10610 - [HUDI-6902] Fix string format of the timestamp in a test

Pull Request - State: closed - Opened by linliu-code 10 months ago - 2 comments

#10609 - RLI Spark Hudi Error occurs when executing map

Issue - State: open - Opened by maheshguptags 10 months ago - 5 comments
Labels: priority:critical, index

#10608 - [SUPPORT] Executor executes action [commits the instant 20240202161708414] error

Issue - State: open - Opened by Toroidals 10 months ago - 6 comments

#10607 - [HUDI-7367] Add makeQualified APIs

Pull Request - State: closed - Opened by yihua 10 months ago - 2 comments
Labels: release-1.0.0

#10606 - [HUDI-7365] Fix a flaky test for timestamp output format

Pull Request - State: closed - Opened by linliu-code 10 months ago - 2 comments

#10605 - [MINOR] Add UT org.apache.hudi.io.TestHoodieTimelineArchiver#testRetryArchivalAfterPreviousFailedDeletion

Pull Request - State: open - Opened by kbuci 10 months ago - 1 comment
Labels: release-0.14.2

#10604 - [HUDI-7351] Implement partition pushdown for glue

Pull Request - State: closed - Opened by parisni 10 months ago - 6 comments

#10603 - [DOCS][WEBSITE] Update team page for pmc and committer list

Pull Request - State: closed - Opened by nfarah86 10 months ago - 2 comments

#10602 - [HUDI-7366] Fix HoodieLocation with encoded paths

Pull Request - State: closed - Opened by yihua 10 months ago - 2 comments
Labels: release-1.0.0

#10601 - [SUPPORT] FileNotFoundException when clustering

Issue - State: open - Opened by echisan 10 months ago - 1 comment

#10600 - [MINOR] Reorder Azure CI test modules

Pull Request - State: closed - Opened by linliu-code 10 months ago - 1 comment

#10599 - [HUDI-7364] Move InLineFs classes to hudi-hadoop-common module

Pull Request - State: open - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10598 - [HUDI-7385] Add config for custom write support for parquet row writer

Pull Request - State: open - Opened by jonvex 10 months ago - 1 comment

#10597 - [Docs] Added known regression note for 0.14.1 release related to ComplexKeyGen

Pull Request - State: closed - Opened by ad1happy2go 10 months ago

#10596 - [HUDI-7362] Fix hudi partition base path scheme to s3

Pull Request - State: open - Opened by parisni 10 months ago - 1 comment

#10595 - [SUPPORT] Athena does not support s3a partition scheme anymore leading to missing data

Issue - State: open - Opened by parisni 10 months ago
Labels: aws-support, priority:critical, release-0.14.2

#10594 - [HUDI-9424]Support using local timezone when writing flink TIMESTAMP data

Pull Request - State: open - Opened by cmmp6 10 months ago - 5 comments

#10593 - [HUDI-7361] Fix a concurrency issue caused by rollbackFailedWrites

Pull Request - State: closed - Opened by eric9204 10 months ago - 1 comment

#10592 - [MINOR] Add serialVersionUID to HoodieRecord class

Pull Request - State: closed - Opened by KingdomWG 10 months ago - 1 comment

#10591 - [HUDI-6497] Replace FileSystem, Path, and FileStatus usage in `hudi-common` module

Pull Request - State: open - Opened by yihua 10 months ago - 2 comments
Labels: release-1.0.0

#10590 - [SUPPORT] java.lang.NoClassDefFoundError: org/apache/hudi/com/fasterxml/jackson/module/scala/DefaultScalaModule$ when doing an Incremental CDC Query in 0.14.1

Issue - State: open - Opened by johnwilsonabartys 10 months ago - 2 comments
Labels: priority:critical, on-call-triaged, reader-core, class-not-found

#10589 - [hudi bucket prune]

Issue - State: closed - Opened by lookingUpAtTheSky 10 months ago - 2 comments
Labels: performance, spark, optimizer

#10588 - [HUDI-7340] Use spillable map for cached log records in HoodieBaseFileGroupRecordBuffer

Pull Request - State: closed - Opened by danny0405 10 months ago - 2 comments

#10587 - Upsert operation not working and job is running longer while using "Record level index" in Apache Hudi 0.14 in EMR 6.15

Issue - State: open - Opened by SudhirSaxena 10 months ago - 23 comments
Labels: performance, priority:critical, priority:major

#10586 - [HUDI-7357] Introduce generic StorageConfiguration

Pull Request - State: open - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10585 - took down the banner

Pull Request - State: closed - Opened by nfarah86 10 months ago

#10584 - Improve left nav for better layout

Pull Request - State: closed - Opened by bhasudha 10 months ago - 1 comment

#10583 - [SUPPORT] Unable to Set Database Name for Hive Metadata Sync using Flink SQL

Issue - State: closed - Opened by vkhoroshko 10 months ago - 3 comments

#10582 - [WIP][HUDI-6472] fix spark sql does not ignore case

Pull Request - State: open - Opened by KnightChess 10 months ago - 1 comment
Labels: spark-sql, release-0.14.2

#10581 - [SUPPORT] Can't delete key (row) for all commits in HUDI Table (history)?

Issue - State: closed - Opened by jens4doc 10 months ago - 4 comments
Labels: priority:minor, feature-enquiry

#10580 - [SUPPORT] Querying Hudi tables with Spark+Velox（C++）, ObjectSizeCalculator.getObjectSize hangs causing about a 50-second delay in queries

Issue - State: open - Opened by majian1998 10 months ago - 6 comments
Labels: performance, priority:major

#10579 - [HUDI-7355] Empty commit should be enbale default to avoid Timeout Exception

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 1 comment

#10578 - Bloom improvements

Pull Request - State: open - Opened by the-other-tim-brown 10 months ago - 2 comments

#10577 - [HUDI-6868] Support extracting passwords from credential store for Hive Sync

Pull Request - State: closed - Opened by ad1happy2go 10 months ago - 1 comment

#10576 - [BUG] Failure Encountered When Reading Hudi with Flink in Batch Runtime Mode and FlinkOptions.READ_AS_STREAMING=false

Issue - State: open - Opened by ailinzhou 10 months ago - 3 comments
Labels: priority:major, flink

#10575 - [HUDI-7347] Introduce SeekableDataInputStream for random access

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10574 - [HUDI-7346] Remove usage of org.apache.hadoop.hbase.util.Bytes

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10573 - [HUDI-7344] Use Java {Input/Output}Stream instead of FSData{Input/Output}Stream when possible

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10572 - [HUDI-7351] Hive-sync partition pushdown does not work with glue

Pull Request - State: closed - Opened by parisni 10 months ago - 2 comments
Labels: aws-support

#10571 - [HUDI-7345] Remove usage of org.apache.hadoop.util.VersionUtil

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10570 - [HUDI-7343] Replace Path.SEPARATOR with HoodieLocation.SEPARATOR

Pull Request - State: closed - Opened by yihua 10 months ago - 2 comments
Labels: release-1.0.0

#10569 - [SUPPORT] feature hive sync partition push down fails with glue

Issue - State: closed - Opened by parisni 10 months ago

#10568 - [HUDI-7342] Use BaseFileUtils to hide format-specific logic in HoodiePartitionMetadata

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10567 - [HUDI-7336] Introduce new HoodieStorage abstraction

Pull Request - State: closed - Opened by yihua 10 months ago - 4 comments
Labels: release-1.0.0

#10566 - [SUPPORT] Hudi CLI bundle not working

Issue - State: open - Opened by CTTY 10 months ago - 1 comment
Labels: priority:major, cli, table-service

#10565 - [HUDI-7337] Implement MetricsReporter that reports metrics to M3

Pull Request - State: open - Opened by kbuci 10 months ago - 1 comment
Labels: release-0.14.2

#10564 - [HUDI-7335] Create hudi-hadoop-common for hadoop-specific implementation

Pull Request - State: closed - Opened by yihua 10 months ago - 1 comment
Labels: release-1.0.0

#10563 - added new videos for hudi oss site

Pull Request - State: closed - Opened by nfarah86 10 months ago - 5 comments

#10562 - [MINOR] add logger to CompactionPlanOperator & ClusteringPlanOperator

Pull Request - State: closed - Opened by eric9204 10 months ago - 1 comment

#10561 - Issue with reading the debezium inputs

Issue - State: open - Opened by zyperd 10 months ago - 4 comments
Labels: priority:major, hudistreamer, on-call-triaged

#10560 - new hudi content for 01-2024

Pull Request - State: closed - Opened by nfarah86 10 months ago

#10559 - Hudi behaviour if AWS Glue concurrency is triggered[SUPPORT]

Issue - State: open - Opened by rishabhreply 10 months ago - 10 comments
Labels: priority:minor, on-call-triaged, concurrency-control

#10558 - [SUPPORT] After upgrading hudi 0.14.1, use Spark SQL merge into to update the matched_action, the case of the column name and the expression name does not match, resulting in an exception.

Issue - State: open - Opened by yihao-tcf 10 months ago - 8 comments
Labels: priority:blocker, spark-sql, on-call-triaged, release-0.14.2

#10557 - updated button size so join now is on one line

Pull Request - State: closed - Opened by nfarah86 10 months ago

#10556 - [HUDI-7327] remove meta cols from incoming schema in stream sync

Pull Request - State: closed - Opened by jonvex 10 months ago - 3 comments

#10555 - [SUPPORT] Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o230.save. Parquet/Avro schema mismatch: Avro field 'id' not found

Issue - State: open - Opened by jayesh2424 10 months ago - 7 comments
Labels: schema-and-data-types, py-spark

#10554 - [MINOR] Fix UT error in HUDI-6941 with stage task numbers

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 1 comment

#10553 - [SUPPORT] Cannot create a hudi table that has a column starting with a digit

Issue - State: closed - Opened by Mourya1319 10 months ago - 9 comments
Labels: schema-and-data-types, priority:minor, spark-sql, on-call-triaged

#10552 - [HUDI-6902] Detect the cause of orphan processes_2

Pull Request - State: closed - Opened by linliu-code 10 months ago - 2 comments

#10551 - [HUDI-7334] Remove EMBEDDED_KV_STORE based FSV usage in tests

Pull Request - State: closed - Opened by linliu-code 10 months ago - 5 comments

#10550 - [MINOR] Splitting UT Spark DataSource into two

Pull Request - State: open - Opened by vinothchandar 10 months ago - 2 comments

#10549 - [HUDI-7323] Use a schema supplier instead of a static value

Pull Request - State: closed - Opened by the-other-tim-brown 10 months ago - 1 comment
Labels: schema-and-data-types, hudistreamer

#10548 - [HUDI-6902] Remove hdfstestservice usages

Pull Request - State: open - Opened by linliu-code 10 months ago - 1 comment

#10547 - [MINOR] Reduce UT spark-datasource test times

Pull Request - State: closed - Opened by vinothchandar 10 months ago - 2 comments

#10546 - [HUDI-7318] HoodieTableMetaClient need support a config to user for whether to checkTableValidity

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 2 comments

#10545 - [BUG]Data duplication, multiple data primary keys are duplicated

Issue - State: closed - Opened by waywtdcc 10 months ago - 4 comments
Labels: priority:minor, data-duplication

#10544 - [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem

Issue - State: open - Opened by LIKE-HUB 10 months ago - 2 comments
Labels: priority:major, flink, table-service

#10543 - [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem

Issue - State: closed - Opened by LIKE-HUB 10 months ago - 1 comment

#10542 - [SUPPORT] Dataloss in FlinkCDC into Hudi without any exception or other infomation

Issue - State: open - Opened by xuzifu666 10 months ago - 10 comments
Labels: flink, data-loss, change-data-capture

#10541 - [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 1 comment

#10540 - [HUDI-7316] Update AbstractHoodieLogRecordReader (and implementation) to accept already-constructed HoodieTableMetaClient and update Spark engine callers to pass meta client directly

Pull Request - State: closed - Opened by kbuci 10 months ago - 1 comment
Labels: performance, metadata

#10539 - [SUPPORT] Flink streaming read MOR table, thrown Unexpected cdc file split infer case: LOG_FILE Exception

Issue - State: closed - Opened by nicholasxu 10 months ago - 7 comments
Labels: priority:major, flink

#10538 - [SUPPORT] Multi Writing unable to acquire lock by using flink with diffrent LockProvider

Issue - State: open - Opened by hanson2021 10 months ago - 2 comments
Labels: priority:major, concurrency-control

#10537 - [HUDI-7315] Disable constructing NOT filter predicate when pushing do…

Pull Request - State: closed - Opened by paul8263 10 months ago - 1 comment

#10536 - [HUDI-7314] Hudi Create table support index type check

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 2 comments

#10535 - initial commit and added applied intuition and penn entertainment to …

Pull Request - State: closed - Opened by nfarah86 10 months ago - 1 comment

#10534 - [HUDI-6902] Take a dump at hadoop-mr-java-client module

Pull Request - State: closed - Opened by linliu-code 10 months ago - 2 comments

#10533 - [SUPPORT] Spark readStream fails with [COLUMN_ALREADY_EXISTS] for streaming tables created with "hoodie.schema.on.read.enable" & "hoodie.datasource.write.reconcile.schema" enabled

Issue - State: open - Opened by imonteroq 10 months ago - 5 comments
Labels: priority:major, on-call-triaged, reader-core, schema-evolution, release-0.14.2

#10532 - [HUDI-7277] fix `hoodie.bulkinsert.shuffle.parallelism` not activated…

Pull Request - State: closed - Opened by KnightChess 10 months ago - 2 comments
Labels: spark

#10531 - [HUDI-7311] Add implicit literal type conversion before filter push down

Pull Request - State: closed - Opened by paul8263 10 months ago - 5 comments
Labels: schema-and-data-types, flink-sql

#10530 - [HUDI-7312] Spark3ParsePartitionUtil support inferPartitionColumnValue with all unnest type

Pull Request - State: closed - Opened by xuzifu666 10 months ago - 1 comment

#10529 - initial commit for web banner

Pull Request - State: closed - Opened by nfarah86 10 months ago - 2 comments

#10528 - [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries

Pull Request - State: closed - Opened by majian1998 10 months ago - 1 comment

#10527 - [MINOR] Added descriptive exception if column present in required avro schema does not exist in hudi table

Pull Request - State: closed - Opened by prathit06 10 months ago - 1 comment

#10526 - [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test

Pull Request - State: open - Opened by Zouxxyy 10 months ago - 1 comment
Labels: test-stability

#10525 - [HUDI-6902] Try container for Azure tests

Pull Request - State: closed - Opened by linliu-code 10 months ago - 4 comments

#10524 - [HUDI-7309] Disable constructing AND & OR filter predicates when filt…

Pull Request - State: closed - Opened by paul8263 10 months ago - 1 comment

#10523 - [HUDI-7308] LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started

Pull Request - State: closed - Opened by kbuci 10 months ago - 6 comments
Labels: metrics, stability

GitHub / apache/hudi issues and pull requests