Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apache/hudi issues and pull requests

#11988 - [HUDI-8212] Add extra config of billing project ID for BigQuery sync

Pull Request - State: closed - Opened by ad1happy2go 2 months ago - 1 comment
Labels: size:S

#11986 - [SUPPORT] Missing logs in need when scan logs for mor snapshot read

Issue - State: closed - Opened by TheR1sing3un 2 months ago - 1 comment
Labels: priority:critical, writer-core, data-loss, concurrency-control

#11985 - [SUPPORT] AWS Glue Pyspark Hudi write job fails to retrieve files in partition folder, although the files exist

Issue - State: open - Opened by bchittari 2 months ago - 7 comments
Labels: aws-support, table-service

#11984 - [MINOR] Pass the avro exception for better information

Pull Request - State: closed - Opened by prabodh1194 2 months ago - 1 comment
Labels: size:S

#11983 - [MINOR] Disable flaky testPartitionStatsWithMultiWriter temporarily

Pull Request - State: closed - Opened by codope 2 months ago - 1 comment
Labels: size:XS

#11982 - [SUPPORT]What is the behavior of compact inline and compact schedule incline

Issue - State: closed - Opened by bithw1 2 months ago - 3 comments
Labels: feature-enquiry, table-service

#11981 - [MINOR] pass the avro exception for better information

Pull Request - State: closed - Opened by prabodh1194 2 months ago - 5 comments
Labels: size:S

#11980 - [MINOR] Fix Azure CI status check to consider multiple runs on the same commit

Pull Request - State: closed - Opened by yihua 2 months ago - 1 comment
Labels: size:S

#11979 - [HUDI-8077] Improve logging in clean planning

Pull Request - State: closed - Opened by linliu-code 2 months ago - 1 comment
Labels: size:S

#11978 - [HUDI-8219] add concurrent schema evolution conflict detection

Pull Request - State: open - Opened by Davis-Zhang-Onehouse 2 months ago - 1 comment
Labels: size:L

#11977 - [HUDI-8221] RFC placeholder

Pull Request - State: closed - Opened by Davis-Zhang-Onehouse 2 months ago - 1 comment
Labels: size:S

#11976 - [MINOR] Fix unknown shorthand flag error with docker demo

Pull Request - State: closed - Opened by lokeshj1703 2 months ago - 1 comment
Labels: size:XS

#11975 - [HUDI-6891] Fix RO queries with RLI and record key predicate

Pull Request - State: closed - Opened by codope 2 months ago - 5 comments
Labels: size:M

#11974 - [SUPPORT]Does Hive query againt Hudi support incremental query support between arbitrary start and end time?

Issue - State: closed - Opened by bithw1 2 months ago - 2 comments
Labels: hive, incremental-query

#11973 - [HUDI-8238] Skip this log file instead of skipping all log files

Pull Request - State: closed - Opened by TheR1sing3un 2 months ago - 6 comments
Labels: size:S

#11972 - [HUDI-8077] Update the completion time for clean metadata

Pull Request - State: open - Opened by linliu-code 2 months ago - 1 comment
Labels: size:S

#11970 - [HUDI-8216] Json to Row conversion failing for Timestamp fields during serialization

Pull Request - State: open - Opened by vamsikarnika 2 months ago - 1 comment
Labels: size:XL

#11969 - [HUDI-8185] Fix SPARK record for Colstats

Pull Request - State: closed - Opened by codope 2 months ago - 5 comments
Labels: size:S

#11968 - Bump com.google.protobuf:protobuf-java from 3.21.7 to 3.25.5

Pull Request - State: closed - Opened by dependabot[bot] 2 months ago - 3 comments
Labels: dependencies, size:XS

#11966 - [HUDI-8179] Upgrade hudi flink connector to 1.20.0

Pull Request - State: closed - Opened by guptashailesh92 2 months ago - 7 comments
Labels: flink, version-upgrade, size:XL

#11964 - Fix CVE-2023-39410 and CVE-2020-13956 from hudi-presto-bundle

Pull Request - State: closed - Opened by nishithakbhaskaran 2 months ago - 6 comments
Labels: size:XS

#11963 - [HUDI-8215] Support composite compaction strategy

Pull Request - State: closed - Opened by TheR1sing3un 2 months ago - 3 comments
Labels: size:M

#11962 - [SUPPORT]Write path of insert/update/upsert on MOR table

Issue - State: closed - Opened by bithw1 2 months ago - 2 comments
Labels: feature-enquiry

#11961 - [HUDI-7848] Fail comparisons between different typed ordering values

Pull Request - State: closed - Opened by linliu-code 2 months ago - 2 comments
Labels: size:M

#11960 - [SUPPORT] Large keyspace upsert results in OOM

Issue - State: open - Opened by meatheadmike 2 months ago - 11 comments
Labels: performance, priority:critical, wide-keyspace-update

#11959 - [SUPPORT] - Data loss after 3 days following upgrade from Hudi 0.11.1 to 0.14.0

Issue - State: open - Opened by RuyRoaV 2 months ago - 2 comments
Labels: priority:critical, data-loss

#11958 - [HUDI-8214] Support specify partitions with regex for compaction

Pull Request - State: closed - Opened by TheR1sing3un 2 months ago - 2 comments
Labels: size:M

#11957 - [HUDI-8213] Exclude jackson-databind from hudi-spark-bundle to fix CVE-2017-17485

Pull Request - State: open - Opened by senthh 2 months ago - 6 comments
Labels: size:XS

#11956 - [HUDI-8212] Add extra config of billing project ID for BigQuery sync

Pull Request - State: closed - Opened by ad1happy2go 2 months ago - 1 comment
Labels: size:S

#11955 - [SUPPORT] Hive meta sync null pointer issue

Issue - State: open - Opened by bytesid19 2 months ago - 12 comments
Labels: meta-sync

#11954 - [MINOR] Remove shaded of codahale metrics in flink bundle.

Pull Request - State: closed - Opened by zhangwl9 2 months ago - 2 comments
Labels: metrics, size:XS

#11953 - [SUPPORT] flink cdc 3.x pipeline hudi sink

Issue - State: open - Opened by melin 2 months ago - 6 comments
Labels: feature-enquiry

#11952 - [HUDI-8191] Fix MockStateInitializationContext#getKeyedStateStore to use non-KeyedStateStore

Pull Request - State: closed - Opened by usberkeley 2 months ago - 1 comment
Labels: size:L

#11951 - [HUDI-7563] Add support to drop index using sql

Pull Request - State: closed - Opened by codope 2 months ago - 1 comment
Labels: size:M

#11949 - [HUDI-8201] Hoodie stand alone catalog design

Pull Request - State: closed - Opened by Davis-Zhang-Onehouse 2 months ago - 1 comment

#11948 - [HUDI-8023] Add multiwriter test for secondary and partition stats index

Pull Request - State: closed - Opened by codope 2 months ago - 1 comment
Labels: size:M

#11947 - [HUDI-8141] Incremental Query with Completion Time

Pull Request - State: open - Opened by CTTY 2 months ago - 2 comments
Labels: size:XL

#11946 - [SUPPORT] How to configure spark and flink to write mor tables using bucket indexes?

Issue - State: open - Opened by xiaofan2022 2 months ago - 12 comments
Labels: performance, index

#11944 - [HUDI-8200] Adding support to configure view storage type with HoodieMetadataTableValidator

Pull Request - State: closed - Opened by nsivabalan 2 months ago - 5 comments
Labels: size:S

#11943 - [HUDI-8203] Make record merge mode the primary merging config

Pull Request - State: closed - Opened by jonvex 2 months ago - 2 comments
Labels: size:XL

#11942 - set default record merger as spark

Pull Request - State: closed - Opened by jonvex 2 months ago - 2 comments
Labels: size:XS

#11941 - [HUDI-5829] Optimize conversion from json to row format when sanitizing field names

Pull Request - State: open - Opened by vamsikarnika 2 months ago - 1 comment
Labels: size:XL

#11934 - [HUDI-8183] Throw exception if record key field does not exist

Pull Request - State: closed - Opened by jonvex 3 months ago - 1 comment
Labels: size:S

#11933 - [SUPPORT]Behavior of streaming read table A join with streaming read table B with Flink

Issue - State: closed - Opened by bithw1 3 months ago - 2 comments
Labels: flink, streaming

#11930 - [HUDI-6909] Add logic to check operation metadata field for Spark Record

Pull Request - State: closed - Opened by linliu-code 3 months ago - 4 comments
Labels: size:S

#11927 - [HUDI-7848] Verify the delete record ordering value comparison

Pull Request - State: closed - Opened by linliu-code 3 months ago - 1 comment
Labels: size:M

#11926 - [HUDI-8187] Hudi 1.0 reader should be able to read both 1.0 and 0.x tables with custom key generator

Pull Request - State: closed - Opened by lokeshj1703 3 months ago - 1 comment
Labels: size:M

#11925 - [MINOR] pass the avro exception for better information

Pull Request - State: closed - Opened by prabodh1194 3 months ago - 9 comments
Labels: size:S

#11923 - [HUDI-8076] Timeline - Support 0.x and 1.x implementation for timeline and related classes

Pull Request - State: closed - Opened by bvaradar 3 months ago - 7 comments
Labels: size:XL

#11922 - [SUPPORT] Comments for partition columns not synced to Hive/AWS Glue

Issue - State: open - Opened by machadoluiz 3 months ago - 1 comment
Labels: meta-sync, schema-and-data-types

#11921 - [HUDI-8188] Add validation for partition stats index in HoodieMetadataTableValidator

Pull Request - State: closed - Opened by lokeshj1703 3 months ago - 1 comment
Labels: size:M

#11918 - [SUPPORT] Clean Operation (Metadata Column Stats Index) failing with Copy on Write table.

Issue - State: open - Opened by robertchinezon 3 months ago - 4 comments
Labels: priority:critical, metadata, table-service

#11914 - [HUDI-8182]Cache internalSchema for hive read, avoid each split reloa…

Pull Request - State: closed - Opened by muyihao 3 months ago - 13 comments
Labels: size:M

#11900 - [SUPPORT] Exception when write null value to table with timestamp partitioning

Issue - State: open - Opened by stream2000 3 months ago - 3 comments
Labels: schema-and-data-types, priority:critical

#11896 - [SUPPORT] Upgrading table through CLI changes from CustomKeyGenerator to SimpleKeyGenerator

Issue - State: open - Opened by mzheng-plaid 3 months ago - 4 comments
Labels: upgrade, version-upgrade

#11896 - [SUPPORT] Upgrading table through CLI changes from CustomKeyGenerator to SimpleKeyGenerator

Issue - State: open - Opened by mzheng-plaid 3 months ago - 4 comments
Labels: upgrade, version-upgrade

#11892 - [SUPPORT] Compaction - Could not find - /opt/demo/config/schema.avsc - schema file

Issue - State: closed - Opened by alberttwong 3 months ago - 3 comments
Labels: table-service

#11892 - [SUPPORT] Compaction - Could not find - /opt/demo/config/schema.avsc - schema file

Issue - State: closed - Opened by alberttwong 3 months ago - 3 comments
Labels: table-service

#11889 - [HUDI-7900] Delete unsupported metadata partitions when downgrade

Pull Request - State: closed - Opened by linliu-code 3 months ago - 3 comments
Labels: size:M

#11881 - [HUDI-7341] Support unmerged log reader for HoodieFileGroupReader

Pull Request - State: closed - Opened by jonvex 3 months ago - 1 comment
Labels: size:M

#11875 - [SUPPORT] Huge Performance Issue With BLOOM Index On A 1.6 Billion COW Table

Issue - State: open - Opened by silly-carbon 3 months ago - 9 comments
Labels: performance, index

#11874 - Multi table streamer

Pull Request - State: open - Opened by smtwilio 3 months ago - 3 comments
Labels: size:S

#11872 - [HUDI-8084] Support Sort Merge Join Compaction

Pull Request - State: closed - Opened by TheR1sing3un 3 months ago - 4 comments
Labels: size:XL

#11871 - [HUDI-8161] Make spark-sql command 'desc' independent from schema evolution config

Pull Request - State: closed - Opened by wombatu-kun 3 months ago - 4 comments
Labels: size:M

#11866 - [HUDI-8103] Introduce Table Write Version and version table configs

Pull Request - State: closed - Opened by vinothchandar 3 months ago - 3 comments
Labels: size:XL

#11864 - [HUDI-8111] Adding support to validate last N file slices with HoodieMetadataValidator

Pull Request - State: closed - Opened by nsivabalan 3 months ago - 1 comment
Labels: size:M

#11864 - [HUDI-8111] Adding support to validate last N file slices with HoodieMetadataValidator

Pull Request - State: closed - Opened by nsivabalan 3 months ago - 1 comment
Labels: size:M

#11858 - [SUPPORT]Schema evolution setting affects Spark's 'describe table' output

Issue - State: closed - Opened by wombatu-kun 3 months ago - 3 comments
Labels: spark-sql

#11853 - [HUDI-8135] Limit number of meta clients created in StreamSync

Pull Request - State: closed - Opened by the-other-tim-brown 3 months ago - 1 comment
Labels: size:M

#11844 - [HUDI-8126] Persist sourceRdd to optimise writeStatus DAG

Pull Request - State: open - Opened by vinishjail97 3 months ago - 1 comment
Labels: size:L

#11835 - [SUPPORT] Properties file corruption caused by write failure

Issue - State: open - Opened by Ytimetravel 3 months ago - 6 comments
Labels: priority:blocker, writer-core

#11835 - [SUPPORT] Properties file corruption caused by write failure

Issue - State: open - Opened by Ytimetravel 3 months ago - 6 comments
Labels: priority:blocker, writer-core

#11832 - [HUDI-8124] Allow reuse of meta client in Meta Sync path

Pull Request - State: closed - Opened by the-other-tim-brown 3 months ago - 2 comments
Labels: meta-sync, code-refactor, size:L

#11818 - [MINOR] Enable column stats by default

Pull Request - State: open - Opened by codope 3 months ago - 3 comments
Labels: size:M

#11816 - [HUDI-8034] Support custom key generator with HoodieCatalogTable

Pull Request - State: closed - Opened by lokeshj1703 3 months ago - 1 comment
Labels: size:L

#11807 - [SUPPORT] Can't redefine array

Issue - State: open - Opened by Ytimetravel 3 months ago - 5 comments
Labels: schema-and-data-types, spark, schema-evolution

#11804 - [HUDI-7916] Add mor hive integration tests bundle validation

Pull Request - State: open - Opened by jonvex 3 months ago - 1 comment
Labels: size:M

#11804 - [HUDI-7916] Add mor hive integration tests bundle validation

Pull Request - State: open - Opened by jonvex 3 months ago - 1 comment
Labels: size:M

#11788 - [HUDI-8089] Remove support for Spark2 and Scala2.11 from Hudi

Pull Request - State: closed - Opened by jonvex 3 months ago - 1 comment
Labels: size:XL

#11785 - Unable to merge cdc records to Hudi snapshot.

Issue - State: open - Opened by rcc1101 3 months ago - 6 comments
Labels: writer-core

#11783 - [SUPPORT] Failed to use Bloom filter Indexing

Issue - State: closed - Opened by Gatsby-Lee 3 months ago - 12 comments
Labels: priority:critical, index, metadata, version-compatibility

#11781 - [SUPPORT]create hive table on top of existing hudi table

Issue - State: closed - Opened by ayan2k21 3 months ago - 4 comments
Labels: meta-sync

#11780 - [HUDI-8066] cherry pick Flink 1.18 into 0.14.2

Pull Request - State: closed - Opened by HuangZhenQiu 3 months ago - 3 comments
Labels: size:XL

#11752 - [HUDI-8068] Hook up source partitions to s3 incr source

Pull Request - State: closed - Opened by rmahindra123 4 months ago - 1 comment
Labels: size:S

#11733 - [WIP]: [HUDI-7947][RFC-80] Support column families (configuration part)

Pull Request - State: open - Opened by wombatu-kun 4 months ago
Labels: size:L

#11727 - [HUDI-7930] Flink Support for Array of Row and Map of Row value

Pull Request - State: closed - Opened by David-N-Perkins 4 months ago - 11 comments
Labels: size:XL

#11708 - [SUPPORT] Data corruption in parquet file in Hudi table (ParquetDecodingException)

Issue - State: open - Opened by mzheng-plaid 4 months ago - 7 comments
Labels: priority:critical, data-corruption

#11706 - [HUDI-8024] Test secondary index updates and rollback

Pull Request - State: open - Opened by codope 4 months ago - 1 comment
Labels: size:M

#11702 - [HUDI-8032] Fix MockStateInitializationContext#getKeyedStateStore to use non-KeyedStateStore

Pull Request - State: closed - Opened by usberkeley 4 months ago - 15 comments
Labels: size:L

#11639 - [HUDI-7919] docker demo spark3.5 support for IT

Pull Request - State: open - Opened by jonvex 4 months ago - 1 comment
Labels: size:XL

#11621 - [MINOR][DO NOT MERGE] Turn on 1.0.0 features by default

Pull Request - State: closed - Opened by codope 5 months ago - 1 comment
Labels: size:S

#11611 - [HUDI-7979] Adjusting defaults with spillable map memory

Pull Request - State: closed - Opened by nsivabalan 5 months ago - 5 comments
Labels: size:M

#11606 - [HUDI-7975] Provide an API to create empty commit

Pull Request - State: open - Opened by suryaprasanna 5 months ago - 3 comments
Labels: size:M