apache/hudi issues and pull requests

#12246 - [MINOR] Update Avro URL in README

Pull Request - State: closed - Opened by bibhu107 17 days ago - 1 comment
Labels: size:XS

#12246 - [MINOR] Update Avro URL in README

Pull Request - State: closed - Opened by bibhu107 17 days ago - 1 comment
Labels: size:XS

#12245 - [HUDI-8394] Restrict multiple bulk inserts into simple bucket COW with disabled Spark native Row

Pull Request - State: open - Opened by geserdugarov 17 days ago - 4 comments
Labels: spark-sql, size:M

#12242 - [HUDI-8468] use payload to do merging inside the expression payload

Pull Request - State: open - Opened by Davis-Zhang-Onehouse 17 days ago - 1 comment
Labels: size:M

#12242 - [HUDI-8468] use payload to do merging inside the expression payload

Pull Request - State: open - Opened by Davis-Zhang-Onehouse 17 days ago - 1 comment
Labels: size:M

#12241 - [HUDI-8508] Fix timeline service port assignment bug

Pull Request - State: closed - Opened by the-other-tim-brown 17 days ago - 1 comment
Labels: size:M

#12240 - [HUDI-8557] Enable metadata on the Spark reader by default

Pull Request - State: open - Opened by codope 18 days ago - 1 comment
Labels: size:XS

#12239 - [MINOR][site] fix: ui updates

Pull Request - State: closed - Opened by pintusoliya 18 days ago - 1 comment
Labels: docs, size:XL

#12239 - [MINOR][site] fix: ui updates

Pull Request - State: closed - Opened by pintusoliya 18 days ago - 1 comment
Labels: docs, size:XL

#12238 - [HUDI-8504] Fix missing database config when building Hudi configs in Spark

Pull Request - State: closed - Opened by fhan688 18 days ago - 2 comments
Labels: size:S

#12238 - [HUDI-8504] Fix missing database config when building Hudi configs in Spark

Pull Request - State: closed - Opened by fhan688 18 days ago - 2 comments
Labels: size:S

#12237 - [HUDI-8503] Fix Trino failure when reading corrupted block at end of log file

Pull Request - State: open - Opened by usberkeley 18 days ago - 1 comment
Labels: size:L

#12236 - [HUDI-8469][WIP][DNM] Adding optimized writes to MDT

Pull Request - State: open - Opened by nsivabalan 18 days ago - 3 comments
Labels: size:XL

#12236 - [HUDI-8469][WIP][DNM] Adding optimized writes to MDT

Pull Request - State: open - Opened by nsivabalan 18 days ago - 3 comments
Labels: size:XL

#12235 - [DOCS] Update sql_ddl.md for Flink SQL table creation with partitioning fix

Pull Request - State: open - Opened by YesIfwRONG 18 days ago
Labels: docs, size:XS

#12234 - [SUPPORT] Hudi Record Level Index says item not found with Complex keys

Issue - State: open - Opened by dataproblems 18 days ago - 5 comments
Labels: schema-and-data-types, priority:critical, index

#12234 - [SUPPORT] Hudi Record Level Index says item not found with Complex keys

Issue - State: open - Opened by dataproblems 18 days ago - 5 comments
Labels: schema-and-data-types, priority:critical, index

#12232 - [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine

Pull Request - State: open - Opened by usberkeley 19 days ago - 3 comments
Labels: size:S

#12232 - [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine

Pull Request - State: open - Opened by usberkeley 19 days ago - 3 comments
Labels: size:S

#12231 - [HUDI-8501] Improve SizeAwareDataInputStream to implement idempotent

Pull Request - State: open - Opened by usberkeley 19 days ago - 6 comments
Labels: size:M

#12230 - [HUDI-8500] Add line wrapping indentation check

Pull Request - State: closed - Opened by usberkeley 19 days ago - 5 comments
Labels: size:XS

#12228 - [HUDI-8499] Complex data types and nested schema support in DataHubSyncTool

Pull Request - State: open - Opened by kroushan-nit 20 days ago - 1 comment
Labels: size:L

#12226 - [HUDI-8498] Fix the async compaction task configuration error in CompactOperator

Pull Request - State: open - Opened by usberkeley 20 days ago - 1 comment
Labels: size:S

#12225 - [HUDI-8497]Check consistency between pk statement and option when create table using HoodieHiveCatalog

Pull Request - State: open - Opened by hehuiyuan 21 days ago - 2 comments
Labels: size:S

#12224 - [HUDI-8395] Fix metaClient handling when running upgrade or downgrade

Pull Request - State: closed - Opened by codope 22 days ago - 1 comment
Labels: size:S

#12224 - [HUDI-8395] Fix metaClient handling when running upgrade or downgrade

Pull Request - State: closed - Opened by codope 22 days ago - 1 comment
Labels: size:S

#12220 - [HUDI-8490] Implicit lock provider use different lock key scheme

Pull Request - State: closed - Opened by Davis-Zhang-Onehouse 22 days ago - 2 comments
Labels: size:S

#12220 - [HUDI-8490] Implicit lock provider use different lock key scheme

Pull Request - State: closed - Opened by Davis-Zhang-Onehouse 22 days ago - 2 comments
Labels: size:S

#12219 - [HUDI-8488] feat: introduce SLF4j metrics reporter

Pull Request - State: closed - Opened by TheR1sing3un 23 days ago - 1 comment
Labels: size:M

#12216 - [HUDI-8487] Stop HoodieTestSuiteJob from creating table

Pull Request - State: open - Opened by jonvex 23 days ago - 1 comment
Labels: size:S

#12216 - [HUDI-8487] Stop HoodieTestSuiteJob from creating table

Pull Request - State: open - Opened by jonvex 23 days ago - 1 comment
Labels: size:S

#12215 - [HUDI-8486] Merge into enforces data type match for some columns

Pull Request - State: open - Opened by Davis-Zhang-Onehouse 23 days ago - 5 comments
Labels: size:XL

#12215 - [HUDI-8486] Merge into enforces data type match for some columns

Pull Request - State: open - Opened by Davis-Zhang-Onehouse 23 days ago - 5 comments
Labels: size:XL

#12206 - [HUDI-8210] Support writing table version 6 log format from 1.x

Pull Request - State: closed - Opened by vinothchandar 25 days ago - 12 comments
Labels: size:XL

#12206 - [HUDI-8210] Support writing table version 6 log format from 1.x

Pull Request - State: closed - Opened by vinothchandar 25 days ago - 12 comments
Labels: size:XL

#12194 - [HUDI-8427] Fix delete in file group reader and re-enable test in TestHoodieSparkMergeOnReadTableInsertUpdateDelete

Pull Request - State: closed - Opened by yihua 27 days ago - 1 comment

#12194 - [HUDI-8427] Fix delete in file group reader and re-enable test in TestHoodieSparkMergeOnReadTableInsertUpdateDelete

Pull Request - State: closed - Opened by yihua 27 days ago - 1 comment

#12182 - [SUPPORT] Hudi CloudWatchReporter error after 0.15.0 upgrade

Issue - State: open - Opened by kirillklimenko about 1 month ago - 1 comment
Labels: aws-support

#12174 - [MINOR] Init partition stats based on latest file slices only

Pull Request - State: open - Opened by codope about 1 month ago - 1 comment
Labels: size:S

#12173 - [HUDI-8450] Optimize the design of EmbeddedTimelineServerHelper#createEmbeddedTimelineService

Pull Request - State: open - Opened by usberkeley about 1 month ago - 1 comment
Labels: size:S

#12172 - Fix usage of logging libraries

Pull Request - State: open - Opened by the-other-tim-brown about 1 month ago - 1 comment
Labels: size:L

#12171 - [HUDI-8448] Fix log block footer incorrectly using HeaderMetadataType

Pull Request - State: open - Opened by usberkeley about 1 month ago - 4 comments
Labels: size:M

#12170 - [HUDI-8447] Claiming RFC-83 for Hudi data is ordered by primary key

Pull Request - State: open - Opened by usberkeley about 1 month ago - 1 comment
Labels: size:XS

#12169 - [SUPPORT] Issue with Hudi Parquet Compression Codec Not Working as Expected

Issue - State: closed - Opened by soumilshah1995 about 1 month ago - 4 comments
Labels: writer-core

#12168 - [SUPPORT]The default behavior of spark sql insert into has changed from upsert to insert?

Issue - State: open - Opened by bithw1 about 1 month ago - 3 comments

#12167 - [DOCS] Add Kuaishou to powered-by page

Pull Request - State: closed - Opened by beyond1920 about 1 month ago
Labels: docs, size:XS

#12166 - [HUDI-8433] Fix not update IssuedInstant when stream read empty commits

Pull Request - State: open - Opened by fhan688 about 1 month ago - 1 comment
Labels: size:S

#12165 - [HUDI-4818] Update partition column type to avoid type conversion failure

Pull Request - State: open - Opened by linliu-code about 1 month ago - 1 comment
Labels: size:XS

#12164 - [HUDI-8442] Reduce timeline loads while rolling back failed writes

Pull Request - State: open - Opened by the-other-tim-brown about 1 month ago - 3 comments
Labels: size:L

#12163 - [MINOR] Add maven cache, update checkout/setup actions

Pull Request - State: closed - Opened by the-other-tim-brown about 1 month ago - 1 comment
Labels: size:S

#12162 - [SITE][MINOR] Add event banner for upcoming community sync

Pull Request - State: closed - Opened by bhasudha about 1 month ago
Labels: docs, size:XS

#12161 - [HUDI-8192] test streaming with custom merger

Pull Request - State: open - Opened by jonvex about 1 month ago - 3 comments
Labels: size:M

#12160 - [HUDI-8432] Fix data skipping with RLI if record key is composite

Pull Request - State: open - Opened by codope about 1 month ago - 1 comment
Labels: size:M

#12159 - [HUDI-8260] Fix col stats metadata validation so that log files are also validated

Pull Request - State: closed - Opened by lokeshj1703 about 1 month ago - 1 comment
Labels: size:M

#12158 - feat: updated blogs design

Pull Request - State: open - Opened by pintusoliya about 1 month ago - 1 comment
Labels: docs, size:XL

#12157 - [HUDI-8428] Encode pruned partitions while fetching functional index

Pull Request - State: open - Opened by codope about 1 month ago - 1 comment
Labels: size:M

#12156 - [SUPPORT] use flinksql write hudi0.15 timestamp(3), use sql-client for hive catalog search timestamp(9),why?

Issue - State: open - Opened by screamedddd about 1 month ago - 1 comment
Labels: schema-and-data-types, flink-sql

#12155 - [SUPPORT] Wrong filtering of values for bucket hashes

Issue - State: closed - Opened by geserdugarov about 1 month ago - 7 comments

#12154 - [SUPPORT] After the hudi table is compressed, the size of the avro log file has not been significantly reduced, and the parquet file has not been significantly increased.

Issue - State: closed - Opened by conorzhao about 1 month ago

#12153 - [HUDI-8326] Add some more functional index tests

Pull Request - State: open - Opened by codope about 1 month ago - 1 comment
Labels: size:M

#12152 - [SUPPORT]Spark reads from all partitions when using composite keys with a record index.

Issue - State: open - Opened by RameshkumarChikoti123 about 1 month ago - 2 comments
Labels: priority:critical, index, metadata, reader-core, data-skipping

#12151 - [HUDI-8263] Add validation for functional index in HoodieMetadataTableValidator

Pull Request - State: open - Opened by lokeshj1703 about 1 month ago - 1 comment
Labels: size:L

#12150 - [HUDI-8400] apply 'write.ignore.failed' when write data failed v2

Pull Request - State: open - Opened by fhan688 about 1 month ago - 4 comments
Labels: size:S

#12149 - [HUDI-7835] Fix and re-enable a disabled test

Pull Request - State: open - Opened by codope about 1 month ago - 1 comment
Labels: size:S

#12148 - Revert "[HUDI-8400] apply 'write.ignore.failed' when write data failed"

Pull Request - State: closed - Opened by danny0405 about 1 month ago - 1 comment
Labels: size:S

#12147 - [MINOR] Avoid log warn message about closing the writer for normal write operations

Pull Request - State: closed - Opened by Zouxxyy about 1 month ago - 1 comment
Labels: size:XS

#12146 - [HUDI-8410] Fix a flaky test for partition stats

Pull Request - State: open - Opened by linliu-code about 1 month ago - 1 comment
Labels: size:S

#12145 - [HUDI-8412] Fix enum reading in spark for Avro log blocks

Pull Request - State: closed - Opened by jonvex about 1 month ago - 1 comment
Labels: size:XS

#12144 - [HUDI-8411] Fix unmerged reader to skip delete blocks and avoid NPE

Pull Request - State: closed - Opened by jonvex about 1 month ago - 1 comment
Labels: size:S

#12143 - [HUDI-8431] Remove redundant table and timeline validity check in HoodieStreamer

Pull Request - State: open - Opened by xiaoxuandev about 1 month ago - 1 comment
Labels: size:S

#12142 - Remove redundant table and timeline validity check in HoodieStreamer

Pull Request - State: closed - Opened by xiaoxuandev about 1 month ago

#12141 - [MINOR] Allow check for uncommitted log files in Metadata Validation

Pull Request - State: closed - Opened by the-other-tim-brown about 1 month ago - 4 comments
Labels: size:M

#12140 - [HUDI-8399] Upgrade protobuf version to 3.25.5 to fix CVE-2024-7254

Pull Request - State: open - Opened by senthh about 1 month ago - 4 comments
Labels: size:XS

#12139 - [SUPPORT] `PartitionedFile`'s size estimation in `FileSourceScanExec#createReadRDD` when enable `NewHoodieParquetFileFormat`

Issue - State: open - Opened by TheR1sing3un about 1 month ago

#12108 - [SUPPORT] Read from hudi table results in crash (com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException)

Issue - State: closed - Opened by meatheadmike about 2 months ago - 6 comments
Labels: clazz-conflict, release-1.0.0-beta2

#12105 - [HUDI-8371] Fix column stats index with MDT for a few scenarios

Pull Request - State: closed - Opened by nsivabalan about 2 months ago - 8 comments
Labels: size:XL

GitHub / apache/hudi issues and pull requests