apache/paimon issues and pull requests

#4308 - Fix symbol

Pull Request - State: closed - Opened by eric666666 30 days ago - 1 comment

#4307 - [core] Support specify snapshot-id and timestamp when query by consumer-id

Pull Request - State: open - Opened by xuzifu666 about 1 month ago - 4 comments

#4306 - [core] Sort some system table query result

Pull Request - State: closed - Opened by askwang about 1 month ago - 2 comments

#4305 - [Docs] Fix wrong explanation and demo in consumer.

Issue - State: closed - Opened by leaves12138 about 1 month ago - 1 comment
Labels: good first issue

#4304 - [core] Manifest and Statistic support query by timestamp

Pull Request - State: open - Opened by herefree about 1 month ago

#4303 - [doc] Add doc for creating table

Pull Request - State: closed - Opened by yuzelin about 1 month ago

#4302 - [WIP][spark] Support scala 2.13

Pull Request - State: open - Opened by Zouxxyy about 1 month ago

#4301 - [flink] Add query service test with deletion vectors options

Pull Request - State: open - Opened by Shadowell about 1 month ago - 2 comments

#4300 - [doc] update unaware-bucket-topo.png

Pull Request - State: closed - Opened by wwj6591812 about 1 month ago

#4299 - [core][spark] Support push down limit for primary key table

Pull Request - State: closed - Opened by ulysses-you about 1 month ago - 4 comments

#4298 - [doc] first-row merge engine adds changelog producer usage documentation.

Pull Request - State: closed - Opened by zhuangchong about 1 month ago

#4297 - [core] Support parallel close writers

Pull Request - State: open - Opened by neuyilan about 1 month ago

#4296 - [spark] Fix push down limit data correctness issue with deletion vector

Pull Request - State: closed - Opened by ulysses-you about 1 month ago - 1 comment

#4295 - [flink][cdc] Add support for retry cnt instead of busy wait and additional support to skip corrupt records in cdc writer

Pull Request - State: open - Opened by AshishKhatkar about 1 month ago - 1 comment

#4294 - Fix InsertOnly behavior for CDC and deduplication scenarios

Pull Request - State: closed - Opened by yunfengzhou-hub about 1 month ago - 2 comments

#4293 - [spark] Add test case for writing nested array

Pull Request - State: closed - Opened by Zouxxyy about 1 month ago - 1 comment

#4292 - [core] Delete tag not failed if tag not exists

Pull Request - State: closed - Opened by askwang about 1 month ago

#4291 - [core] Manifest and Statistic support query by tag name

Pull Request - State: closed - Opened by xuzifu666 about 1 month ago - 2 comments

#4290 - [Feature] Avoid logging full rows with sensitive information on conversion failure in Flink CDC

Issue - State: open - Opened by atallahade about 1 month ago
Labels: enhancement

#4289 - Bump org.apache.avro:avro from 1.11.1 to 1.11.4 in /paimon-flink/paimon-flink-cdc

Pull Request - State: closed - Opened by dependabot[bot] about 1 month ago
Labels: dependencies

#4288 - [fix][flink] Fix Iceberg compatible metadata cannot be read when data file format is parquet

Pull Request - State: closed - Opened by tsreaper about 1 month ago

#4287 - [core] Filter data file while executing local orphan clean

Pull Request - State: closed - Opened by bknbkn about 1 month ago - 4 comments

#4286 - [core] Optimize multiple commit to reduce conflicts

Pull Request - State: closed - Opened by JingsongLi about 1 month ago

#4285 - [spark][flink] Introduce orphan file cleaning local and distributed mode

Pull Request - State: closed - Opened by bknbkn about 1 month ago - 3 comments

#4284 - [test] add more test case for schema evolution with schema included in records

Pull Request - State: closed - Opened by zhuyaogai about 1 month ago - 2 comments

#4283 - [Hive] Add AWS Glue Catalog Support

Pull Request - State: closed - Opened by Moonlight-CL about 1 month ago - 1 comment

#4282 - [Feature] AWS Glue Metastore support

Issue - State: closed - Opened by Moonlight-CL about 1 month ago
Labels: enhancement

#4281 - [flink] Emit event time lag should not increase when no new records are read

Pull Request - State: closed - Opened by tsreaper about 1 month ago - 1 comment

#4280 - [Flink] Support analysis statistics in flink

Pull Request - State: closed - Opened by herefree about 1 month ago - 2 comments

#4279 - [hotfix] Fix that cannot add new entry to partitionEntries

Pull Request - State: closed - Opened by yuzelin about 1 month ago - 1 comment

#4278 - [core] Use java11 as default

Pull Request - State: open - Opened by FangYongs about 1 month ago - 5 comments

#4277 - [core] Support rename tag action and procedure

Pull Request - State: closed - Opened by xuzifu666 about 1 month ago - 7 comments

#4276 - [test] add test cases for manifest file full compaction

Pull Request - State: closed - Opened by LsomeYeah about 1 month ago

#4275 - [spark] Support push down aggregate with group by partition column

Pull Request - State: closed - Opened by ulysses-you about 1 month ago - 1 comment

#4274 - [Feature] Branch allows for setting expiration times.

Issue - State: open - Opened by sunxiaojian about 1 month ago - 2 comments
Labels: enhancement

#4273 - [flink] partial-update merge engine support batch deletion using flink sql

Pull Request - State: closed - Opened by zhuangchong about 1 month ago

#4272 - [core] Check existence before expire: more check.

Pull Request - State: closed - Opened by leaves12138 about 1 month ago

#4271 - [hotfix] Change 'toLowerCase' to 'allowUpperCase'

Pull Request - State: closed - Opened by yuzelin about 1 month ago

#4270 - [core] Delete redundant if statement when produce changelog by lookup for first row.

Pull Request - State: closed - Opened by wwj6591812 about 1 month ago - 2 comments

#4269 - [spark] Support nested col pruning

Pull Request - State: closed - Opened by Zouxxyy about 1 month ago - 1 comment

#4268 - [test] Fix unstable tests in MySqlSyncDatabaseTableListITCase

Pull Request - State: closed - Opened by tsreaper about 1 month ago

#4267 - [Bug] when Dedicated Compaction use combined mode, restore from checkpoint ,then error：This exception is intentionally thrown after committing the restored checkpoints By restarting the job we hope that writers can start writing based on these new commits.

Issue - State: open - Opened by dsanww about 1 month ago
Labels: bug

#4266 - [core] Sort the expired partitions and add max_expires param

Pull Request - State: closed - Opened by askwang about 1 month ago - 2 comments

#4265 - [Bug] when table set deletion-vectors.enabled =true, call query_service error.

Issue - State: open - Opened by herefree about 1 month ago
Labels: bug

#4264 - [spark] Cleanup Spark3.1 files

Pull Request - State: closed - Opened by ulysses-you about 1 month ago - 1 comment

#4263 - [arrow] Enable upper-case field name in arrow format writer

Pull Request - State: closed - Opened by leaves12138 about 1 month ago - 1 comment

#4262 - [test] Fix unstable tests in PrimaryKeyFileStoreTableITCase

Pull Request - State: closed - Opened by tsreaper about 1 month ago

#4261 - [e2e] Fix kafka consumer concurrent exception

Pull Request - State: closed - Opened by Shadowell about 2 months ago

#4260 - [core] Optimize UnawareAppendTableCompactionCoordinator to avoid OOM

Pull Request - State: closed - Opened by JingsongLi about 2 months ago

#4259 - [spark] Support push down aggregate

Pull Request - State: closed - Opened by ulysses-you about 2 months ago - 2 comments

#4258 - [core] Push bucket filter into manifest entry reader

Pull Request - State: closed - Opened by JingsongLi about 2 months ago

#4257 - [core] Fix serialize name _DELETION_VECTORS_RANGES conflict

Pull Request - State: closed - Opened by Shadowell about 2 months ago - 1 comment

#4256 - [core] Make ClientPool simple to reduce thread safe bugs

Pull Request - State: closed - Opened by JingsongLi about 2 months ago

#4255 - [flink] Small changelog files can now be compacted into big files

Pull Request - State: open - Opened by tsreaper about 2 months ago - 2 comments

#4254 - [doc] Fix comment syntax errors

Pull Request - State: closed - Opened by eric9204 about 2 months ago - 4 comments

#4253 - [flink] Make MultiUnawaureTablesReader use its own logger

Pull Request - State: closed - Opened by eric9204 about 2 months ago - 3 comments

#4252 - [core] Add serial version ID for aggr functions

Pull Request - State: closed - Opened by Shadowell about 2 months ago - 1 comment

#4251 - [core] Support statistic with time travel

Pull Request - State: closed - Opened by xuzifu666 about 2 months ago - 5 comments

#4250 - [doc] fix cdc doc url 404

Pull Request - State: closed - Opened by MOBIN-F about 2 months ago

#4250 - [doc] fix cdc doc url 404

Pull Request - State: closed - Opened by MOBIN-F about 2 months ago

#4249 - [Feature] Support Flink sourceIdleTime metric in Paimon Source

Issue - State: open - Opened by xiangyuf about 2 months ago
Labels: enhancement

#4249 - [Feature] Support Flink sourceIdleTime metric in Paimon Source

Issue - State: open - Opened by xiangyuf about 2 months ago
Labels: enhancement

#4248 - [flink] fix same primary key cannot be inserted again after deletion in Partial Update merge engine.

Pull Request - State: closed - Opened by zhuangchong about 2 months ago - 2 comments

#4247 - [Bug] Use partial-update.remove-record-on-delete option to add new data exception after deleting a record

Issue - State: closed - Opened by zhuangchong about 2 months ago
Labels: bug

#4246 - [common][flink] Add support for complex types in kafka debezium avro cdc action

Pull Request - State: closed - Opened by AshishKhatkar about 2 months ago - 2 comments

#4245 - [format] Format prefix in option keys are processed in each format

Pull Request - State: closed - Opened by tsreaper about 2 months ago - 2 comments

#4244 - [Bug] Flink currentFetchEventTimeLag metric calculation is wrong when the datastream is completely blocked

Issue - State: open - Opened by xiangyuf about 2 months ago
Labels: bug

#4243 - [core] Introduce type option

Pull Request - State: closed - Opened by JingsongLi about 2 months ago - 1 comment

#4242 - [Feature] shrink Paimon format package size

Issue - State: open - Opened by FANNG1 about 2 months ago
Labels: enhancement

#4241 - [flink] Optimize Hadoop configuration loading

Pull Request - State: closed - Opened by zhuanshenbsj1 about 2 months ago

#4240 - [core] Fast return current table if target branch is same with current

Pull Request - State: closed - Opened by ulysses-you about 2 months ago

#4239 - [Bug] A single bad message can cause Flink CDC writer to stuck in an infinite loop waiting for the schema change

Issue - State: open - Opened by AshishKhatkar about 2 months ago - 5 comments
Labels: bug

#4238 - [doc] Fix CompactionAction doc misspelling

Pull Request - State: closed - Opened by eric9204 about 2 months ago - 4 comments

#4237 - [spark] remove spark 3.1

Pull Request - State: closed - Opened by YannByron about 2 months ago - 2 comments

#4236 - [flink] Support count star push down to source for append table

Pull Request - State: closed - Opened by JingsongLi about 2 months ago

#4235 - [core] Check snapshot existence before expire

Pull Request - State: closed - Opened by leaves12138 about 2 months ago

#4234 - [doc] Fix spelling error of parameter name

Pull Request - State: closed - Opened by eric9204 about 2 months ago - 2 comments

#4233 - [spark] Fix the loadTable of SparkSource can't recognize correct catalog

Pull Request - State: open - Opened by harveyyue about 2 months ago

#4232 - [Bug] AppendOnly Table use managed memory write throws error：java.lang.IllegalArgumentException: The fraction of memory to allocate should not be 0. Please make sure that all types of managed memory consumers contained in the job are configured with a non-negative weight via `taskmanager.memory.managed.consumer-weights`

Issue - State: open - Opened by dsanww about 2 months ago
Labels: bug

#4231 - [format][orc] open orc switch useSelected,allowSARGToFilter to make sure pushdown works

Pull Request - State: open - Opened by ranxianglei about 2 months ago - 3 comments

#4230 - [core] fix typo in TableSchema.java

Pull Request - State: closed - Opened by eltociear about 2 months ago - 2 comments

#4229 - [core] Optimize IncrementalStartingScanner to randomlyExecute

Pull Request - State: closed - Opened by JingsongLi about 2 months ago - 1 comment

#4228 - [core] Reduce unnecessary manifest reading during orphan clean

Pull Request - State: closed - Opened by bknbkn about 2 months ago - 1 comment

#4227 - [core] Add immutable id for system field

Pull Request - State: closed - Opened by Zouxxyy about 2 months ago - 3 comments

#4226 - [spark] Support migrate database procedure for spark

Pull Request - State: closed - Opened by xuzifu666 about 2 months ago - 2 comments

#4225 - Bump com.google.protobuf:protobuf-java from 3.19.6 to 3.25.5 in /paimon-format

Pull Request - State: closed - Opened by dependabot[bot] about 2 months ago - 1 comment
Labels: dependencies

#4224 - [flink] Remove scan.push-down support which should be supported by Flink

Pull Request - State: closed - Opened by JingsongLi about 2 months ago - 1 comment

#4223 - [core][spark]support format table create, and implement format table for SparkCatalog

Pull Request - State: closed - Opened by adrian-wang about 2 months ago - 4 comments

#4222 - Compatible with Spark4 （upgrade antlr4 to version 4.13.1 Compatible with jdk17 ）

Pull Request - State: open - Opened by awol2005ex about 2 months ago

#4221 - [flink] Set default parallelism for sink in cases where AQE not supported

Pull Request - State: closed - Opened by yunfengzhou-hub about 2 months ago

#4220 - [cdc] Avoid duplicate schema file generation

Pull Request - State: closed - Opened by codeTai about 2 months ago

#4219 - [flink] Remove state from append only unaware bucket writer

Pull Request - State: closed - Opened by tsreaper about 2 months ago - 1 comment

#4218 - [spark] Bump Spark 3.5.3

Pull Request - State: closed - Opened by ulysses-you about 2 months ago - 2 comments

#4217 - [spark] PaimonSplitScan supports column pruning and filter push down

Pull Request - State: closed - Opened by ulysses-you about 2 months ago - 2 comments

#4216 - [Feature] Support for the create table like syntax of the spark sql engine

Issue - State: open - Opened by jacklong319 about 2 months ago
Labels: enhancement

#4215 - [core] Improve error message for concurrent snapshot expiration

Pull Request - State: closed - Opened by yunfengzhou-hub about 2 months ago - 2 comments

#4214 - [core] Introduce withReadType in ReadBuilder

Pull Request - State: closed - Opened by Zouxxyy about 2 months ago - 3 comments

#4213 - [core] Add Table.uuid method

Pull Request - State: open - Opened by JingsongLi about 2 months ago

#4212 - [doc] fix the configuration error of primary key in table building

Pull Request - State: closed - Opened by eric9204 about 2 months ago

#4211 - [hotfix] fix unspecified value parameter when using PaimonMetadataColumn.get method

Pull Request - State: closed - Opened by zhuangchong about 2 months ago - 1 comment

GitHub / apache/paimon issues and pull requests