apache/incubator-paimon issues and pull requests

#2766 - [Bug] fix sort compaction failed on empty input

Pull Request - State: closed - Opened by Aitozi 10 months ago - 2 comments

#2765 - [core] Fix that TagManager doesn't handle case where more than 1 tags are created based on the same snapshot

Pull Request - State: closed - Opened by yuzelin 10 months ago

#2764 - [hotfix] Doc revision

Pull Request - State: closed - Opened by MonsterChenzhuo 10 months ago - 2 comments

#2763 - [cdc] fix cdc watermark value emit error

Pull Request - State: open - Opened by huyuanfeng2018 10 months ago - 10 comments

#2762 - [flink] Fix the problem that flink job for reading paimon won't recov…

Pull Request - State: closed - Opened by bridgeDream 10 months ago - 1 comment

#2761 - [Bug] Flink can't recover from exception as 'OutOfRangeException' when sometime the paimon snapshot is expired

Issue - State: closed - Opened by bridgeDream 10 months ago
Labels: bug

#2760 - [Hive] HiveCatalog: Table StorageDescriptor location and control HMS FileSystem scan.

Pull Request - State: open - Opened by hongyonggan 10 months ago

#2759 - [core][branch] Add branches system table

Pull Request - State: open - Opened by FangYongs 10 months ago

#2758 - [Feature] Add branches system table

Issue - State: open - Opened by FangYongs 10 months ago
Labels: enhancement

#2757 - [core]: fix flaky test `testSavepointTag`.

Pull Request - State: closed - Opened by zhongyujiang 10 months ago - 3 comments

#2756 - [Feature] Support reporting isProcessingBacklog as an input for checkpointing delay

Issue - State: open - Opened by schnappi17 10 months ago
Labels: enhancement

#2755 - [hive] Fix paimon table comment cannot be synchronized to hive metastore

Pull Request - State: closed - Opened by herefree 10 months ago

#2754 - [core][branch] Add branches in tags table

Pull Request - State: closed - Opened by FangYongs 10 months ago - 2 comments

#2753 - [Feature] Add branches in tags table

Issue - State: closed - Opened by FangYongs 10 months ago
Labels: enhancement

#2752 - [spark] Support ANALYZE table

Pull Request - State: closed - Opened by Zouxxyy 10 months ago - 2 comments

#2751 - [core] Support skip rewrite when upgrade in ChangelogMergeTreeRewriter

Pull Request - State: closed - Opened by Zouxxyy 10 months ago - 2 comments

#2750 - [WIP][core] Introduce stats system table

Pull Request - State: closed - Opened by MonsterChenzhuo 10 months ago - 1 comment

#2749 - [Flink]add range strategy for sort compaction

Pull Request - State: open - Opened by wg1026688210 10 months ago - 1 comment

#2748 - [Core] Support branch batch/streaming read and write

Pull Request - State: closed - Opened by TaoZex 11 months ago - 6 comments

#2747 - [flink] Unified use of JsonSerdeUtil

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago

#2746 - [hotfix] The new column exception shows the specific column name in the cdc database synchronization action.

Pull Request - State: closed - Opened by zhuangchong 11 months ago

#2745 - [Bug] `CdcWatermarkStrategy` The current system time will always be sent as the watermark value.

Issue - State: open - Opened by huyuanfeng2018 11 months ago
Labels: bug

#2744 - [doc] Use underscore instead of hyphen for rollback_to in doc.

Pull Request - State: closed - Opened by liming30 11 months ago

#2743 - [Spark]Spark support create and delete branch procedure

Pull Request - State: open - Opened by TaoZex 11 months ago

#2742 - [Feature] The maximum watermark value of the current commit should be reported by `CommitterMetrics`

Issue - State: open - Opened by huyuanfeng2018 11 months ago - 2 comments
Labels: enhancement

#2741 - [CDC] Add all data types test for mysql sync database

Pull Request - State: closed - Opened by TaoZex 11 months ago

#2740 - [core] Remove duplicates LookupCompaction

Pull Request - State: closed - Opened by Zouxxyy 11 months ago

#2739 - [format]Fix orc and parquet writer about timestamp not contains [local timezone] and [is_adjust_to_utc]

Pull Request - State: closed - Opened by leoyy0316 11 months ago

#2738 - [core] Introduce expire_snapshots procedure

Pull Request - State: closed - Opened by JingsongLi 11 months ago

#2737 - [Bug] Official website spark jumps 404

Issue - State: closed - Opened by Xikl 11 months ago - 2 comments
Labels: bug

#2736 - [core] Fix bug: zindexer should deal well with column `null` value.

Pull Request - State: closed - Opened by leaves12138 11 months ago

#2735 - [Hive] Fix hive Table StorageDescriptor location is empty issue.

Pull Request - State: closed - Opened by hongyonggan 11 months ago

#2734 - [cdc] Added postgresql table cdc synchronization action

Pull Request - State: closed - Opened by zhuangchong 11 months ago

#2733 - [POC] Introduce Encryption Capability for Paimon

Pull Request - State: closed - Opened by zhangjun0x01 11 months ago

#2731 - [spark] Bump Spark version 3.3.4

Pull Request - State: closed - Opened by cxzl25 11 months ago

#2730 - [flink] Introduce dbz cdc dataType

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago - 3 comments

#2729 - [Bug] modify paimon table failed when using hive-metastore

Issue - State: closed - Opened by gary0416 11 months ago - 5 comments
Labels: bug

#2726 - [Feature] Support stream/batch write data to branch

Issue - State: open - Opened by FangYongs 11 months ago - 1 comment
Labels: enhancement

#2725 - [core][branch] Add procedure in flink for create/delete branch

Pull Request - State: closed - Opened by FangYongs 11 months ago

#2723 - [Feature] Add Procedure in flink for creating and deleting branch

Issue - State: closed - Opened by FangYongs 11 months ago - 3 comments
Labels: enhancement

#2721 - [hive]Open the cascade to update

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago - 3 comments

#2720 - [Feature] Support for the creation of composite primary keys using database, table, and existing primary key in Paimon.

Issue - State: open - Opened by ElancerBlack 11 months ago - 2 comments
Labels: enhancement

#2717 - [spark] Fix filter push down failed while triggers a sort compact job

Pull Request - State: closed - Opened by leaves12138 11 months ago - 2 comments

#2716 - [Feature] Support Oracle CDC to Paimon

Issue - State: open - Opened by Pandas886 11 months ago
Labels: enhancement

#2715 - [Feature] Support SqlServer CDC to Paimon

Issue - State: open - Opened by Pandas886 11 months ago - 5 comments
Labels: enhancement

#2710 - [Feature] Support Python API for Paimon

Issue - State: open - Opened by Pandas886 11 months ago - 3 comments
Labels: enhancement

#2706 - [Feature][cdc] Handle Kafka CDC Debezium/Canal JSON from Flink SQL

Issue - State: open - Opened by JingsongLi 11 months ago - 2 comments
Labels: enhancement

#2701 - [cdc] support debezium-json format with schema for kafka sync action

Issue - State: open - Opened by zhangjun0x01 11 months ago - 8 comments
Labels: enhancement

#2697 - [e2e] fix ContainerLaunchException

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago - 2 comments

#2696 - [core] Introduce bloom filter for local lookup cache file

Pull Request - State: closed - Opened by Aitozi 11 months ago - 10 comments

#2695 - [WIP][service] Introduce load action

Pull Request - State: open - Opened by MonsterChenzhuo 11 months ago

#2694 - [WIP][core] Introduce exceptions system table

Pull Request - State: open - Opened by MonsterChenzhuo 11 months ago

#2679 - [flink] append watermark cdc Ingestion IT

Pull Request - State: open - Opened by MonsterChenzhuo 11 months ago - 1 comment

#2677 - [core] Introduce stats in snapshot

Pull Request - State: closed - Opened by Zouxxyy 11 months ago - 6 comments

#2675 - [Bug] Dedicated Compaction for write-only table cann't clean up small files after running for a long time

Issue - State: open - Opened by bridgeDream 11 months ago - 4 comments
Labels: bug

#2670 - [Feature] Whole database compression combined mode does not support append unware bucket table

Issue - State: open - Opened by thomasg19930417 11 months ago - 3 comments
Labels: enhancement

#2661 - [flink] cdc support close idle redaer

Pull Request - State: open - Opened by zhourui999 11 months ago

#2658 - [oss] use multi-release mechanism to ship jaxb

Pull Request - State: open - Opened by zhoulii 11 months ago - 2 comments

#2652 - [core] Implement FilesTable's predicate filter

Pull Request - State: closed - Opened by XuQianJin-Stars 11 months ago - 1 comment

#2646 - [core] snapshot create idle timeout

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago - 2 comments

#2575 - [cdc] Support minute and second expressions for cdc sync

Pull Request - State: open - Opened by TaoZex 11 months ago

#2574 - Implement currentEmitEventTimeLag for Flink source

Pull Request - State: closed - Opened by tsreaper 11 months ago

#2573 - [cdc] Support topic-pattern in kafka/pulsar table synchronization

Pull Request - State: closed - Opened by yuzelin 11 months ago

#2572 - [Core]Support product function for agg table

Pull Request - State: closed - Opened by TaoZex 11 months ago - 1 comment

#2571 - nest table poc

Pull Request - State: open - Opened by wg1026688210 11 months ago

#2570 - [core] Support aggregation system table

Pull Request - State: open - Opened by MonsterChenzhuo 11 months ago - 1 comment

#2569 - Add metric to measure the read tps

Pull Request - State: open - Opened by Aitozi 11 months ago

#2568 - [service] Introduce network server and client

Pull Request - State: open - Opened by JingsongLi 11 months ago

#2567 - [Hive] HiveCatalog add hive client pool

Pull Request - State: open - Opened by XuQianJin-Stars 11 months ago - 1 comment

#2566 - [core] Support tag date formatter

Pull Request - State: open - Opened by MonsterChenzhuo 11 months ago - 1 comment

#2565 - [core] The agg table model supports count types

Pull Request - State: closed - Opened by MonsterChenzhuo 11 months ago

#2564 - [core] Introduce nested-update agg to support aggregate nested table

Pull Request - State: closed - Opened by yuzelin 11 months ago

#2563 - [Flink][Spark]Support avro format to migrate hive table to paimon

Pull Request - State: open - Opened by TaoZex 11 months ago - 1 comment

#2562 - [flink] reset currentFetchEventTimeLag after splits are all consumed

Pull Request - State: closed - Opened by Aitozi 11 months ago

#2561 - [Bug] Agg with DELETE has strange behavior

Issue - State: closed - Opened by yuzelin 11 months ago - 1 comment
Labels: bug

#2560 - [Bug] The currentFetchEventTimeLag should reflect the no input data case

Issue - State: closed - Opened by Aitozi 11 months ago
Labels: bug

#2559 - [spark] MergeIntoTableTest for all spark versions

Pull Request - State: closed - Opened by YannByron 11 months ago - 1 comment

#2558 - [BugFix]Fix timestamp type write parquet file not have logicaltype

Pull Request - State: closed - Opened by leoyy0316 11 months ago

#2557 - [Bug] Timestamp type not have logicaltype in parquet footer

Issue - State: closed - Opened by leoyy0316 11 months ago
Labels: bug

#2556 - [flink] add limit partition request for query

Pull Request - State: open - Opened by zhangjun0x01 11 months ago

#2555 - [flink] build schema after match in the sync action

Pull Request - State: closed - Opened by zhangjun0x01 11 months ago

#2554 - [metric]Add running compaction count metric

Pull Request - State: open - Opened by shidayang 12 months ago - 1 comment

#2553 - [doc] Aggregation model function document optimization

Pull Request - State: closed - Opened by MonsterChenzhuo 12 months ago - 1 comment

#2552 - [core]Loader jaxb-api from parent class loader

Pull Request - State: closed - Opened by shidayang 12 months ago

#2551 - [Bug] Spark 3.4.1 create table as select broken

Issue - State: open - Opened by gfunc 12 months ago - 2 comments
Labels: bug

#2550 - [core] Fix that some tag creations haven't handle tag callbacks

Pull Request - State: closed - Opened by yuzelin 12 months ago

#2549 - [spark] Support hilbert curve sort action in spark

Pull Request - State: closed - Opened by TaoZex 12 months ago - 3 comments

#2548 - [Bug] Support modify non physical column comment

Pull Request - State: closed - Opened by Aitozi 12 months ago

#2547 - [Bug] Support modify non physical column comment

Issue - State: closed - Opened by Aitozi 12 months ago
Labels: bug

#2546 - [core] Optimize snapshot expire loop for consumers

Pull Request - State: closed - Opened by JingsongLi 12 months ago

#2545 - [core] The agg table model supports replace types

Pull Request - State: closed - Opened by MonsterChenzhuo 12 months ago - 1 comment

#2544 - [cdc] Support 'topic-pattern' for kafka and pulsar cdc

Pull Request - State: closed - Opened by yuzelin 12 months ago

#2543 - [flink] Fix that schema validation fails when using 'scan.x' options to do time travel on schema changed tables

Pull Request - State: closed - Opened by yuzelin 12 months ago

#2542 - [doc]Change to Trino documentation regarding installation

Pull Request - State: closed - Opened by shidayang 12 months ago

#2541 - [core] remove Dynamic Bucket Row

Pull Request - State: closed - Opened by leaves12138 12 months ago

#2540 - [core] Sort partition before batch insert to avoid out-of-memory error.

Pull Request - State: closed - Opened by leaves12138 12 months ago - 2 comments

#2539 - [flink] Optimize Flink Lookup Join: Bulk load for initialization

Pull Request - State: closed - Opened by JingsongLi 12 months ago

#2538 - [Catalog]Set auto-create = false when using FilesystemCatalog to create table

Pull Request - State: closed - Opened by hehuiyuan 12 months ago - 1 comment

#2537 - [Flink] remove schemaFileExists check for showing tables when using HiveCatalog

Pull Request - State: closed - Opened by wg1026688210 12 months ago

#2536 - [core] Optimize HashBucketAssigner to more parallilism with less initialized bucket

Pull Request - State: closed - Opened by JingsongLi 12 months ago

GitHub / apache/incubator-paimon issues and pull requests