Ecosyste.ms: Issues

An open API service for providing issue and pull request metadata for open source projects.

GitHub / GlobalFishingWatch/pipe-segment issues and pull requests

#155 - Adds missing configuration to vessel_info table

Pull Request - State: closed - Opened by smpiano about 1 year ago

#154 - Adds missing configuration to satellite_timing_offsets table

Pull Request - State: closed - Opened by smpiano about 1 year ago

#153 - Adds support for Python 3.8 and Apache Beam 2.49

Pull Request - State: closed - Opened by smpiano about 1 year ago

#152 - Pipe-v2.5: Adds support for python-3.8 and AB-2.49

Pull Request - State: closed - Opened by smpiano about 1 year ago

#151 - Jenn.qa cleanup

Pull Request - State: closed - Opened by jennvanosdel over 1 year ago

#150 - Whitelist the messages segmented strict to the schema before writing

Pull Request - State: closed - Opened by smpiano over 1 year ago

#146 - Switch the satellite offsets table from daily sharded to partitioned

Pull Request - State: closed - Opened by smpiano over 1 year ago - 1 comment

#145 - Jenn.qa cleanup

Pull Request - State: closed - Opened by jennvanosdel over 1 year ago

#144 - Adds support for labels to audit the jobs.

Pull Request - State: closed - Opened by smpiano over 1 year ago

#143 - split read fragments up by year to try to prevent a timeout

Pull Request - State: closed - Opened by smpiano almost 2 years ago - 2 comments

#142 - Fix fragment compare binsperday increased

Pull Request - State: closed - Opened by smpiano almost 2 years ago

#141 - Try to reduce shuffle

Pull Request - State: closed - Opened by bitsofbits about 2 years ago - 1 comment

#140 - Small segment_vessel_daily fix

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago - 1 comment

#139 - Jenn.segment identity daily fixes

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago

#138 - segment_identity_daily fixes

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago - 2 comments

#137 - Add QA notebooks

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago

#136 - Fix for issues with cumulative identities

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago

#135 - Properly aggregate cumulative identities in segments

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago - 1 comment

#133 - Fixed write of the segment_identity_daily_ table when is in backfill mode

Pull Request - State: closed - Opened by smpiano about 2 years ago - 1 comment

#132 - sketch out how to write segment identity by day -- needed to add summ…

Pull Request - State: closed - Opened by bitsofbits about 2 years ago - 1 comment

#131 - Fixed write of the segment_identity_daily_ table when is in backfill mode

Pull Request - State: closed - Opened by smpiano about 2 years ago

#130 - Sat timing fixes part 2

Pull Request - State: closed - Opened by jennvanosdel about 2 years ago

#129 - Pipe-2.5: Increment AB version to 2.40 to maintain DF SDK support.

Pull Request - State: closed - Opened by smpiano about 2 years ago

#128 - Update the version of Apache beam to 2.40.0

Pull Request - State: closed - Opened by smpiano about 2 years ago

#126 - Add Fragment Table

Pull Request - State: closed - Opened by bitsofbits about 2 years ago

#125 - Stabilize segments generation

Pull Request - State: closed - Opened by bitsofbits about 2 years ago

#124 - Fix add cumulative data

Pull Request - State: closed - Opened by bitsofbits over 2 years ago

#123 - Clean up deprecated code

Pull Request - State: closed - Opened by smpiano over 2 years ago

#122 - Feature/pipeline 735

Pull Request - State: closed - Opened by smpiano over 2 years ago

#121 - Fixes tests and Dataflow job posted and working well

Pull Request - State: closed - Opened by smpiano over 2 years ago - 2 comments

#120 - Fix hot keys and Add Atomic Identities

Pull Request - State: closed - Opened by bitsofbits over 2 years ago - 1 comment

#119 - Segmenter won't run in yearly mode

Issue - State: open - Opened by bitsofbits about 3 years ago

#117 - Uses cloudbuild instead of Travis

Pull Request - State: closed - Opened by smpiano over 3 years ago

#116 - Adds support for Beam 2.28.0

Pull Request - State: closed - Opened by smpiano over 3 years ago

#115 - Remove points with likely bad timestamps due to satellite clock noise.

Pull Request - State: closed - Opened by bitsofbits over 3 years ago - 1 comment

#114 - Uses the new source_date_range_nodash method

Pull Request - State: closed - Opened by andres-arana almost 4 years ago

#113 - PIPELINE-155: Adds segment identity check

Pull Request - State: closed - Opened by andres-arana almost 4 years ago

#112 - Adds segmenter_params to segment step

Pull Request - State: closed - Opened by smpiano almost 4 years ago

#110 - Adds frozen dependencies in the docker image

Pull Request - State: closed - Opened by smpiano almost 4 years ago - 1 comment

#109 - Updates the segmenter to 0.20.1.

Pull Request - State: closed - Opened by andres-arana about 4 years ago

#108 - PIPELINE-70: Early noise removal

Pull Request - State: closed - Opened by andres-arana about 4 years ago - 1 comment

#107 - Adds feature to enable disable flag to run aggregate queries

Pull Request - State: closed - Opened by smpiano about 4 years ago

#106 - Fix `segment_identity_daily`

Pull Request - State: closed - Opened by bitsofbits over 4 years ago

#105 - Pipe 3: Add Stitcher and Thinner

Pull Request - State: closed - Opened by bitsofbits over 4 years ago

#104 - Updates to the version pipe-tools:v3.1.2

Pull Request - State: closed - Opened by smpiano over 4 years ago

#102 - Migrates to flexible operator

Pull Request - State: closed - Opened by smpiano over 4 years ago

#101 - Support New Segmenter

Pull Request - State: closed - Opened by bitsofbits almost 5 years ago

#100 - Segmenter is memory hungry

Issue - State: open - Opened by bitsofbits almost 5 years ago

#99 - Gfw tasks 1015 type a vs b

Pull Request - State: closed - Opened by enriquetuya over 5 years ago

#98 - 1000 dropped messages

Pull Request - State: closed - Opened by andres-arana over 5 years ago

#97 - Migrate from pipe-tools to airflow-gfw

Pull Request - State: closed - Opened by enriquetuya over 5 years ago

#96 - Support for Yearly Mode in Pipe-Segment

Pull Request - State: closed - Opened by enriquetuya over 5 years ago - 3 comments

#95 - Add width and length to identity tables

Pull Request - State: closed - Opened by enriquetuya over 5 years ago - 1 comment

#94 - Add length and width identifiers freq

Pull Request - State: closed - Opened by enriquetuya over 5 years ago

#93 - Gfw tasks 935 staging run changes

Pull Request - State: closed - Opened by enriquetuya over 5 years ago

#92 - Single ident ssvid

Pull Request - State: closed - Opened by pwoods25443 over 5 years ago

#91 - Single Ident SSVID

Issue - State: closed - Opened by pwoods25443 over 5 years ago - 2 comments

#90 - Duplicate timestamps

Issue - State: open - Opened by pwoods25443 over 5 years ago

#89 - Review segmenter params

Issue - State: open - Opened by pwoods25443 over 5 years ago - 1 comment

#88 - Increase spoofing threshold for segment_vessel_daily

Pull Request - State: closed - Opened by pwoods25443 over 5 years ago

#87 - Increase the noise threshold for determination of spoofing

Issue - State: closed - Opened by pwoods25443 over 5 years ago

#86 - Assign ident messages to segments with matching shipname/callsign

Pull Request - State: closed - Opened by pwoods25443 over 5 years ago

#85 - Prefer segments with the same shipname/callsign

Issue - State: closed - Opened by pwoods25443 over 5 years ago

#84 - Name normalization for bouys

Issue - State: open - Opened by pwoods25443 over 5 years ago

#83 - Best vessel_id in segment_info table

Pull Request - State: closed - Opened by pwoods25443 almost 6 years ago

#82 - vessel_id in segment_info

Issue - State: closed - Opened by pwoods25443 almost 6 years ago

#81 - message type

Pull Request - State: closed - Opened by pwoods25443 almost 6 years ago

#79 - Segment info patch for ident_count field

Pull Request - State: closed - Opened by pwoods25443 almost 6 years ago - 1 comment

#78 - Legacy tables did not get schema change in segment_info and vessel_info

Issue - State: closed - Opened by pwoods25443 almost 6 years ago - 1 comment

#76 - Ranked vessel_id per segment

Pull Request - State: closed - Opened by pwoods25443 almost 6 years ago

#75 - Ranked vessel_id per segment

Issue - State: closed - Opened by pwoods25443 almost 6 years ago - 1 comment

#74 - Remove 'noise' field from vessel_info table schema

Pull Request - State: closed - Opened by pwoods25443 almost 6 years ago

#71 - Minimum frequency threshold for most common ident value determination

Pull Request - State: closed - Opened by pwoods25443 about 6 years ago - 1 comment

#70 - Deprecate identity_messages_monthly and segment_identity

Issue - State: open - Opened by pwoods25443 about 6 years ago

#69 - Eliminate 1-time callsigns from vesssel_id

Issue - State: closed - Opened by pwoods25443 about 6 years ago - 1 comment

#68 - Bump pipe-tools to 0.1.7

Pull Request - State: closed - Opened by enriquetuya about 6 years ago

#67 - Remove false IMOs from vessel_id

Issue - State: open - Opened by pwoods25443 about 6 years ago

#66 - Refactor Segment Identity

Pull Request - State: closed - Opened by pwoods25443 about 6 years ago
Labels: enhancement

#65 - Refactor segment_identity

Issue - State: closed - Opened by pwoods25443 about 6 years ago - 2 comments

#64 - Alt segment_info table

Issue - State: closed - Opened by pwoods25443 about 6 years ago - 2 comments

#63 - Good_segments

Issue - State: open - Opened by pwoods25443 about 6 years ago - 2 comments

#62 - Release v0.2.4

Issue - State: closed - Opened by pwoods25443 about 6 years ago

#61 - Include noise flag and message count in segment_info

Pull Request - State: closed - Opened by pwoods25443 about 6 years ago - 2 comments

#60 - Include noise factors in segment_info

Issue - State: closed - Opened by pwoods25443 about 6 years ago

#59 - Parameterize max_num_workers

Pull Request - State: closed - Opened by pwoods25443 over 6 years ago - 1 comment