Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / apache/gobblin issues and pull requests

#3952 - [GOBBLIN-2073] Use previous eventTime for lease arbitration of reminder dagActions

Pull Request - State: closed - Opened by umustafi 9 months ago - 5 comments

#3930 - Enhance `ExecuteGobblinWorkflow` to return more meaningful `@Data`

Pull Request - State: closed - Opened by phet 10 months ago

#3875 - [GOBBLIN-2000] Add logging for concurrent flow status check

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3874 - [GOBBLIN-1999] Ignore concurrent check if the flow execution ID is the same as the c…

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3873 - [GOBBLIN-1998] Add Gobblin-temporal to gobblin-all

Pull Request - State: closed - Opened by homatthew about 1 year ago - 1 comment

#3872 - [GOBBLIN-1997] Avoid deleting flowSpec too early

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3869 - [GOBBLIN-1993] Add iceberg-distcp config to exclude copying 'manifest.json' files

Pull Request - State: closed - Opened by phet about 1 year ago - 1 comment

#3868 - [GOBBLIN-1992] Propagate slf4j MDC Context in workflows and activities of the tempor…

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3867 - [GOBBLIN-1991] set (target) dataset path correctly in RecursiveCopyableDataset

Pull Request - State: closed - Opened by arjun4084346 about 1 year ago - 1 comment

#3866 - Added comment to run tests

Pull Request - State: closed - Opened by umustafi about 1 year ago

#3865 - [GOBBLIN-1996] Add ability for Yarn app to terminate on finishing of temporal flow

Pull Request - State: closed - Opened by homatthew about 1 year ago - 1 comment

#3864 - [GOBBLIN-1990] Update GobblinServiceManagerTest to reduce flakiness

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3863 - [draft] Pr dag refactor stage 3

Pull Request - State: open - Opened by arjun4084346 about 1 year ago - 2 comments

#3862 - [GOBBLIN-1988] Fail the streaming container when OOM issue happens

Pull Request - State: closed - Opened by ZihanLi58 about 1 year ago - 1 comment

#3861 - [GOBBLIN-1987] Allow run-immediately flows to execute in multi-active scheduler mode

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3860 - [GOBBLIN-1986] Log `FileStatus` for only the first N inputs in `GobblinWorkUnitsInputFormat`

Pull Request - State: closed - Opened by phet about 1 year ago - 1 comment

#3858 - Pr dag refactor stage 2

Pull Request - State: open - Opened by arjun4084346 about 1 year ago - 1 comment

#3857 - [GOBBLIN-1984] Add consensus flowExecutionId to FlowSpec to use for compilation

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3856 - send dunamic workunit split message through HDFS channel

Pull Request - State: open - Opened by hanghangliu about 1 year ago

#3854 - [GOBBLIN-1982] Show a consistent flowExecutionId btwn Compilation & Execution

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3853 - [GOBBLIN-1910] part one of the changes that dag refactoring will require

Pull Request - State: closed - Opened by arjun4084346 about 1 year ago - 1 comment

#3852 - [GOBBLIN-1981] Renames writer.path.type config name as it has a type conflict with w…

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3851 - [GOBBLIN-1978] Initialize dag action store monitor metrics

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3847 - [GOBBLIN-1975] Keep job.name configuration immutable if specified on GaaS

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3846 - [GOBBLIN-1974] Ensure Adhoc Flows can be Executed in Multi-active Scheduler state

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3841 - [GOBBLIN-1970] Consolidate processing dag actions to one code path

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3840 - [GOBBLIN-1969] Increase Visibility for Flow Compilation Failures

Pull Request - State: open - Opened by umustafi about 1 year ago

#3839 - [GOBBLIN-1962] Fix failed to acquire job lock

Pull Request - State: open - Opened by Apexhit about 1 year ago

#3838 - [GOBBLIN-1967] Add external data node for generic ingress/egress on GaaS

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3837 - Delete Launch Action Events After Processing

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3836 - Prevent NPE in `FlowCompilationValidationHelper.validateAndHandleConcurrentExecution`

Pull Request - State: closed - Opened by phet about 1 year ago - 1 comment

#3834 - [GOBBLIN-1961] Use DB-qualified table ID as `IcebergTable` dataset descriptor

Pull Request - State: closed - Opened by phet about 1 year ago - 1 comment

#3833 - [GOBBLIN-1960] Emit audit count after commit in IcebergMetadataWriter

Pull Request - State: closed - Opened by homatthew about 1 year ago - 1 comment

#3832 - [GOBBLIN-1947] Send workUnitChange event when helix task consistently fail

Pull Request - State: closed - Opened by hanghangliu about 1 year ago - 1 comment

#3831 - [GOBBLIN-1959] Add semantics for failure on partial success

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3830 - [GOBBLIN-1958] Consistently handle /flowexecutions errors for KILL and RESUME actions

Pull Request - State: closed - Opened by phet about 1 year ago - 1 comment

#3829 - [GOBBLIN-1968] Temporal commit step integration

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3828 - [GOBBLIN-1957] GobblinOrcwriter improvements for large records

Pull Request - State: closed - Opened by Will-Lo about 1 year ago - 1 comment

#3826 - [GOBBLIN-1953] Add an exception message to orc writer validation GTE

Pull Request - State: closed - Opened by homatthew about 1 year ago - 1 comment

#3825 - [draft] Dag refactor

Pull Request - State: open - Opened by arjun4084346 about 1 year ago - 1 comment

#3824 - Emit metric to tune LeaseArbiter Linger metric

Pull Request - State: closed - Opened by umustafi about 1 year ago - 1 comment

#3823 - Fix FlowSpec Updating Function

Pull Request - State: closed - Opened by umustafi about 1 year ago - 2 comments

#3822 - [GOBBLIN-1952] Make jobname shortening in GaaS more aggressive

Pull Request - State: closed - Opened by Will-Lo over 1 year ago - 1 comment

#3821 - [GOBBLIN-1951] Emit GTE when deleting corrupted ORC files

Pull Request - State: closed - Opened by homatthew over 1 year ago - 1 comment

#3819 - [GOBBLIN-1948] Use same flowExecutionId across participants

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3818 - [Hotfix][GOBBLIN-1949] add option to detect malformed orc during commit

Pull Request - State: closed - Opened by hanghangliu over 1 year ago - 4 comments

#3817 - Add framework and unit tests for DagActionStoreChangeMonitor

Pull Request - State: closed - Opened by umustafi over 1 year ago - 4 comments

#3814 - Make KafkaTopicGroupingWorkUnitPacker pack with desired num of container

Pull Request - State: closed - Opened by hanghangliu over 1 year ago - 1 comment

#3813 - [GOBBLIN-1943] Use AWS version 1.12.261 to fix a security vulnerability in the previ…

Pull Request - State: closed - Opened by Will-Lo over 1 year ago - 1 comment

#3812 - [GOBBLIN-1942] Create MySQL util class for re-usable methods and setup MysqlDagActio…

Pull Request - State: closed - Opened by umustafi over 1 year ago - 3 comments

#3809 - [GOBBLIN-1939] Bump AWS version to use a compatible version of Jackson with Gobblin

Pull Request - State: closed - Opened by Will-Lo over 1 year ago - 1 comment

#3808 - [GOBBLIN-1937] Quantify Missed Work Completed by Reminders

Pull Request - State: closed - Opened by umustafi over 1 year ago - 2 comments

#3807 - [GOBBLIN-1935] Skip null dag action types unable to be processed

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3806 - GOBBLIN-1933]Change the logic in completeness verifier to support multi reference tier

Pull Request - State: closed - Opened by ZihanLi58 over 1 year ago - 1 comment

#3805 - [GOBBLIN-1934] Monitor High Level Consumer queue size

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3804 - [GOBBLIN-1938] preserve x bit in manifest file based copy

Pull Request - State: closed - Opened by arjun4084346 over 1 year ago - 3 comments

#3802 - [GOBBLIN-1929] add dataset root in some common type of datasets

Pull Request - State: closed - Opened by arjun4084346 over 1 year ago - 1 comment

#3801 - [GOBBLIN-1931] Refactor dag action updating method & add clarifying comment

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3800 - [GOBBLIN-1930] Improve Multi-active related logs and metrics

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3797 - [GOBBLIN-1926] Fix Reminder Event Epsilon Comparison

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3796 - Change debug statements to info temporarily to debug

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3795 - [GOBBLIN-1924] Reminder event flag true

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3793 - [GOBBLIN-1927] Add topic validation support in KafkaSource, and add TopicNameValidator

Pull Request - State: closed - Opened by wsarecv over 1 year ago - 2 comments

#3792 - [GOBBLIN-1923] Add retention for lease arbiter table

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3791 - [draft] Catch rte

Pull Request - State: closed - Opened by arjun4084346 over 1 year ago

#3790 - [GOBBLIN-1921] Properly handle reminder events

Pull Request - State: closed - Opened by umustafi over 1 year ago - 1 comment

#3788 - [GOBBLIN-1920] Use db laundered timestamp for reminder event

Pull Request - State: closed - Opened by umustafi over 1 year ago - 2 comments

#3787 - [GOBBLIN-1918] Use Exponential Decay for RowBatch resizing

Pull Request - State: closed - Opened by Will-Lo over 1 year ago - 1 comment

#3786 - [GOBBLIN-1917] Logging updates for Salesforce classes

Pull Request - State: closed - Opened by gautamguptabasant over 1 year ago - 1 comment

#3785 - [GOBBLIN-1915] Gobblin on Temporal proof of concept implementation

Pull Request - State: closed - Opened by homatthew over 1 year ago - 1 comment