GlobalFishingWatch/encounters_pipeline issues and pull requests

#72 - Disable partition filter enforcement over the encounters table

Pull Request - State: closed - Opened by smpiano 12 months ago

#71 - Pipe-v3: Adds support for python-3.8 and AB-2.49

Pull Request - State: closed - Opened by smpiano over 1 year ago

#70 - Pipe-v2.5: Adds support for python-3.8 and AB-2.49

Pull Request - State: closed - Opened by smpiano over 1 year ago

#69 - Adds PipelineOptions to each TestPipeline to make tests work

Pull Request - State: closed - Opened by smpiano over 1 year ago

#68 - Prepare raw_encounters and encounter to run in the pipe3

Pull Request - State: closed - Opened by smpiano over 1 year ago

#67 - Handle null course

Pull Request - State: closed - Opened by smpiano about 2 years ago

#66 - Changes to support pipe 3

Pull Request - State: closed - Opened by smpiano about 2 years ago

#65 - Pipe-2.5: Increments AB version to 2.40 to maintain DF SDK support

Pull Request - State: closed - Opened by smpiano over 2 years ago

#64 - Ensures that each neighbor is only added once & stability sorting records by ID

Pull Request - State: closed - Opened by smpiano over 2 years ago

#63 - Adds entry in CHANGES and increments version of project

Pull Request - State: closed - Opened by smpiano over 2 years ago

#62 - ensure that each neighbor is only added once.

Pull Request - State: closed - Opened by smpiano over 2 years ago

#61 - Adds Docker and requierements for scheduler and worker

Pull Request - State: closed - Opened by smpiano over 2 years ago

#60 - Replaces the wait to wait_for_job to avoid confusion when running in …

Pull Request - State: closed - Opened by smpiano about 3 years ago

#59 - Adds the drop of overlapping and short segments when merging encounters

Pull Request - State: closed - Opened by smpiano about 3 years ago

#58 - Feature/pipeline 367

Pull Request - State: closed - Opened by smpiano over 3 years ago

#57 - Uses cloudbuild instead of Travis

Pull Request - State: closed - Opened by smpiano over 3 years ago

#56 - Spline rather than interpolate

Issue - State: open - Opened by bitsofbits over 3 years ago

#55 - Adds support for Apache Beam 2.28.0

Pull Request - State: closed - Opened by smpiano over 3 years ago

#54 - Seg id based encounters

Pull Request - State: closed - Opened by bitsofbits over 3 years ago - 2 comments

#53 - Adds testing function that includes tolerance in floating point comparation

Pull Request - State: closed - Opened by smpiano about 4 years ago - 1 comment

#52 - More pipe-3 improvements

Pull Request - State: closed - Opened by bitsofbits about 4 years ago

#51 - Fix Longitude Averaging Across Dateline on Develop Branch

Pull Request - State: closed - Opened by bitsofbits about 4 years ago

#50 - Fix Longitude Averaging Across Dateline

Pull Request - State: closed - Opened by bitsofbits about 4 years ago

#49 - Stabilize Encounter Merge

Pull Request - State: closed - Opened by bitsofbits about 4 years ago

#48 - Pipe 3: Encounters with Track Id

Pull Request - State: closed - Opened by bitsofbits over 4 years ago

#47 - Updates to the version pipe-tools:v3.1.2

Pull Request - State: closed - Opened by smpiano over 4 years ago

#46 - Removes append in CreateOptions

Pull Request - State: closed - Opened by smpiano over 4 years ago - 1 comment

#45 - Features/37 update dag

Pull Request - State: closed - Opened by smpiano over 4 years ago

#44 - Replaces segment to legacy segment table

Pull Request - State: closed - Opened by smpiano over 4 years ago

#43 - Pins to ujson==1.35 and pipe-tools:v3.1.1

Pull Request - State: closed - Opened by smpiano over 4 years ago

#42 - Updates to pipe-tools:v3.0.0 and Beam 2.16

Pull Request - State: closed - Opened by smpiano almost 5 years ago

#41 - Supports airflow-gfw lib and pipe-tools v2.0.0

Pull Request - State: closed - Opened by smpiano over 5 years ago

#40 - Gfw tasks 990 yearly mode

Pull Request - State: closed - Opened by enriquetuya over 5 years ago

#39 - Bumps to version of pipe-tools 0.2.5

Pull Request - State: closed - Opened by smpiano almost 6 years ago

#38 - 828 - Removes event publication as it's now on pipe-events

Pull Request - State: closed - Opened by andres-arana about 6 years ago

#37 - Bump version of pipe-tools to 0.1.7

Pull Request - State: closed - Opened by enriquetuya about 6 years ago

#36 - Update Distance to Port Filter

Pull Request - State: closed - Opened by bitsofbits over 6 years ago - 1 comment

#35 - filter out noise segments

Pull Request - State: closed - Opened by bitsofbits over 6 years ago - 1 comment

#34 - Release v0.2.0

Pull Request - State: closed - Opened by pwoods25443 over 6 years ago

#33 - Release v0.2.0

Issue - State: closed - Opened by pwoods25443 over 6 years ago

#32 - publish_events operation

Pull Request - State: closed - Opened by pwoods25443 over 6 years ago

#31 - Release v0.1.19

Pull Request - State: closed - Opened by pwoods25443 over 6 years ago

#30 - unit tests fail on diff in least significant digits

Issue - State: closed - Opened by pwoods25443 over 6 years ago - 1 comment

#29 - Release v0.1.19

Issue - State: closed - Opened by pwoods25443 over 6 years ago

#28 - Make pipeline more configurable from command line

Pull Request - State: closed - Opened by bitsofbits over 6 years ago

#27 - Release v0.1.18

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#26 - Release 0.1.18

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#25 - Backfill flag

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#24 - Backfill mode in airflow

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#23 - Filter Encounters Output To Date Range

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago - 2 comments

#22 - Release 0.1.17

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#21 - Combine merge_encounters with the daily run

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#20 - Release 0.1.17

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#19 - Return most common mmsi / svid

Issue - State: closed - Opened by bitsofbits almost 7 years ago

#18 - Combine Merge with the Daily pipeline

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#17 - Output neighbors table from raw_encounters

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#16 - output neighbors table

Issue - State: closed - Opened by pwoods25443 almost 7 years ago - 1 comment

#15 - Release v0.1.16

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#14 - Release 0.1.16

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#13 - Break out merge into a separate dag and fix the start date

Pull Request - State: closed - Opened by pwoods25443 almost 7 years ago

#12 - Fix merge start date

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#11 - Filter inland encounters 2

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#10 - Filter out inland encounters

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#9 - Release 0.1.15

Issue - State: closed - Opened by pwoods25443 almost 7 years ago

#8 - Update dag parameters

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago - 2 comments

#7 - Adapt to new pipeline

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#6 - Airflow changes

Issue - State: closed - Opened by pwoods25443 almost 7 years ago - 1 comment

#5 - Generate Neighbors Table / Improve Dags

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#4 - Package for Airflow

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#3 - Preparing encounters for public release

Issue - State: closed - Opened by natemiller almost 7 years ago - 2 comments

#2 - Enable Multiple Tables

Pull Request - State: closed - Opened by bitsofbits almost 7 years ago

#1 - Rerun encounters

Issue - State: closed - Opened by bitsofbits almost 7 years ago - 3 comments

GitHub / GlobalFishingWatch/encounters_pipeline issues and pull requests