Ecosyste.ms: Issues
An open API service for providing issue and pull request metadata for open source projects.
GitHub / GlobalFishingWatch/pipe-segment issues and pull requests
#158 - Makes the segment step runs for the VMS data. Disabled satellite dependencies and fields not present.
Pull Request -
State: open - Opened by smpiano 10 months ago
#157 - Adds the seg_id as clustering field for the segment_info and disbles the PFE in the satellite_timing_offset
Pull Request -
State: closed - Opened by smpiano 10 months ago
#156 - Updates table and column descriptons and sets labels in segment_info.
Pull Request -
State: closed - Opened by smpiano 11 months ago
#155 - Adds missing configuration to vessel_info table
Pull Request -
State: closed - Opened by smpiano about 1 year ago
#154 - Adds missing configuration to satellite_timing_offsets table
Pull Request -
State: closed - Opened by smpiano about 1 year ago
#153 - Adds support for Python 3.8 and Apache Beam 2.49
Pull Request -
State: closed - Opened by smpiano about 1 year ago
#152 - Pipe-v2.5: Adds support for python-3.8 and AB-2.49
Pull Request -
State: closed - Opened by smpiano about 1 year ago
#151 - Jenn.qa cleanup
Pull Request -
State: closed - Opened by jennvanosdel over 1 year ago
#150 - Whitelist the messages segmented strict to the schema before writing
Pull Request -
State: closed - Opened by smpiano over 1 year ago
#149 - Removes the use of noise and shiptype fields deprecated by segment_identity_daily
Pull Request -
State: closed - Opened by smpiano over 1 year ago
#148 - PIPELINE-1262: Fixes normalized and denormalized values missmatching on vessel info
Pull Request -
State: closed - Opened by andres-arana over 1 year ago
#147 - Fixing error in reading fragments when want to re-runs segment with already present fragment_ tables.
Pull Request -
State: closed - Opened by smpiano over 1 year ago
#146 - Switch the satellite offsets table from daily sharded to partitioned
Pull Request -
State: closed - Opened by smpiano over 1 year ago
- 1 comment
#145 - Jenn.qa cleanup
Pull Request -
State: closed - Opened by jennvanosdel over 1 year ago
#144 - Adds support for labels to audit the jobs.
Pull Request -
State: closed - Opened by smpiano over 1 year ago
#143 - split read fragments up by year to try to prevent a timeout
Pull Request -
State: closed - Opened by smpiano almost 2 years ago
- 2 comments
#142 - Fix fragment compare binsperday increased
Pull Request -
State: closed - Opened by smpiano almost 2 years ago
#141 - Try to reduce shuffle
Pull Request -
State: closed - Opened by bitsofbits about 2 years ago
- 1 comment
#140 - Small segment_vessel_daily fix
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
- 1 comment
#139 - Jenn.segment identity daily fixes
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
#138 - segment_identity_daily fixes
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
- 2 comments
#137 - Add QA notebooks
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
#136 - Fix for issues with cumulative identities
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
#135 - Properly aggregate cumulative identities in segments
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
- 1 comment
#134 - Fixing potential bugs related to discrepancies in messages_segmented and sat_time_offsets
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
- 1 comment
#133 - Fixed write of the segment_identity_daily_ table when is in backfill mode
Pull Request -
State: closed - Opened by smpiano about 2 years ago
- 1 comment
#132 - sketch out how to write segment identity by day -- needed to add summ…
Pull Request -
State: closed - Opened by bitsofbits about 2 years ago
- 1 comment
#131 - Fixed write of the segment_identity_daily_ table when is in backfill mode
Pull Request -
State: closed - Opened by smpiano about 2 years ago
#130 - Sat timing fixes part 2
Pull Request -
State: closed - Opened by jennvanosdel about 2 years ago
#129 - Pipe-2.5: Increment AB version to 2.40 to maintain DF SDK support.
Pull Request -
State: closed - Opened by smpiano about 2 years ago
#128 - Update the version of Apache beam to 2.40.0
Pull Request -
State: closed - Opened by smpiano about 2 years ago
#127 - Fixes little issue, source table was not formatting from template and throw error
Pull Request -
State: closed - Opened by smpiano about 2 years ago
#126 - Add Fragment Table
Pull Request -
State: closed - Opened by bitsofbits about 2 years ago
#125 - Stabilize segments generation
Pull Request -
State: closed - Opened by bitsofbits about 2 years ago
#124 - Fix add cumulative data
Pull Request -
State: closed - Opened by bitsofbits over 2 years ago
#123 - Clean up deprecated code
Pull Request -
State: closed - Opened by smpiano over 2 years ago
#122 - Feature/pipeline 735
Pull Request -
State: closed - Opened by smpiano over 2 years ago
#121 - Fixes tests and Dataflow job posted and working well
Pull Request -
State: closed - Opened by smpiano over 2 years ago
- 2 comments
#120 - Fix hot keys and Add Atomic Identities
Pull Request -
State: closed - Opened by bitsofbits over 2 years ago
- 1 comment
#119 - Segmenter won't run in yearly mode
Issue -
State: open - Opened by bitsofbits about 3 years ago
#118 - Collect pipe-segment changes that are slated for first round of pipeline improvements
Pull Request -
State: closed - Opened by bitsofbits over 3 years ago
#117 - Uses cloudbuild instead of Travis
Pull Request -
State: closed - Opened by smpiano over 3 years ago
#116 - Adds support for Beam 2.28.0
Pull Request -
State: closed - Opened by smpiano over 3 years ago
#115 - Remove points with likely bad timestamps due to satellite clock noise.
Pull Request -
State: closed - Opened by bitsofbits over 3 years ago
- 1 comment
#114 - Uses the new source_date_range_nodash method
Pull Request -
State: closed - Opened by andres-arana almost 4 years ago
#113 - PIPELINE-155: Adds segment identity check
Pull Request -
State: closed - Opened by andres-arana almost 4 years ago
#112 - Adds segmenter_params to segment step
Pull Request -
State: closed - Opened by smpiano almost 4 years ago
#111 - Updates gpsdio-segment to 0.20.2 which supports back and forward time identities
Pull Request -
State: closed - Opened by andres-arana almost 4 years ago
#110 - Adds frozen dependencies in the docker image
Pull Request -
State: closed - Opened by smpiano almost 4 years ago
- 1 comment
#109 - Updates the segmenter to 0.20.1.
Pull Request -
State: closed - Opened by andres-arana about 4 years ago
#108 - PIPELINE-70: Early noise removal
Pull Request -
State: closed - Opened by andres-arana about 4 years ago
- 1 comment
#107 - Adds feature to enable disable flag to run aggregate queries
Pull Request -
State: closed - Opened by smpiano about 4 years ago
#106 - Fix `segment_identity_daily`
Pull Request -
State: closed - Opened by bitsofbits over 4 years ago
#105 - Pipe 3: Add Stitcher and Thinner
Pull Request -
State: closed - Opened by bitsofbits over 4 years ago
#104 - Updates to the version pipe-tools:v3.1.2
Pull Request -
State: closed - Opened by smpiano over 4 years ago
#103 - Uses start_time of default_args instead of pipeline_start_date Airflow variable
Pull Request -
State: closed - Opened by smpiano over 4 years ago
#102 - Migrates to flexible operator
Pull Request -
State: closed - Opened by smpiano over 4 years ago
#101 - Support New Segmenter
Pull Request -
State: closed - Opened by bitsofbits almost 5 years ago
#100 - Segmenter is memory hungry
Issue -
State: open - Opened by bitsofbits almost 5 years ago
#99 - Gfw tasks 1015 type a vs b
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
#98 - 1000 dropped messages
Pull Request -
State: closed - Opened by andres-arana over 5 years ago
#97 - Migrate from pipe-tools to airflow-gfw
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
#96 - Support for Yearly Mode in Pipe-Segment
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
- 3 comments
#95 - Add width and length to identity tables
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
- 1 comment
#94 - Add length and width identifiers freq
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
#93 - Gfw tasks 935 staging run changes
Pull Request -
State: closed - Opened by enriquetuya over 5 years ago
#92 - Single ident ssvid
Pull Request -
State: closed - Opened by pwoods25443 over 5 years ago
#91 - Single Ident SSVID
Issue -
State: closed - Opened by pwoods25443 over 5 years ago
- 2 comments
#90 - Duplicate timestamps
Issue -
State: open - Opened by pwoods25443 over 5 years ago
#89 - Review segmenter params
Issue -
State: open - Opened by pwoods25443 over 5 years ago
- 1 comment
#88 - Increase spoofing threshold for segment_vessel_daily
Pull Request -
State: closed - Opened by pwoods25443 over 5 years ago
#87 - Increase the noise threshold for determination of spoofing
Issue -
State: closed - Opened by pwoods25443 over 5 years ago
#86 - Assign ident messages to segments with matching shipname/callsign
Pull Request -
State: closed - Opened by pwoods25443 over 5 years ago
#85 - Prefer segments with the same shipname/callsign
Issue -
State: closed - Opened by pwoods25443 over 5 years ago
#84 - Name normalization for bouys
Issue -
State: open - Opened by pwoods25443 over 5 years ago
#83 - Best vessel_id in segment_info table
Pull Request -
State: closed - Opened by pwoods25443 almost 6 years ago
#82 - vessel_id in segment_info
Issue -
State: closed - Opened by pwoods25443 almost 6 years ago
#81 - message type
Pull Request -
State: closed - Opened by pwoods25443 almost 6 years ago
#80 - Integrate gpsdio-segment v0.12 Prefer segments with the same message type
Issue -
State: closed - Opened by pwoods25443 almost 6 years ago
#79 - Segment info patch for ident_count field
Pull Request -
State: closed - Opened by pwoods25443 almost 6 years ago
- 1 comment
#78 - Legacy tables did not get schema change in segment_info and vessel_info
Issue -
State: closed - Opened by pwoods25443 almost 6 years ago
- 1 comment
#77 - Take class A/B into account when asigning messages to segments
Issue -
State: open - Opened by pwoods25443 almost 6 years ago
#76 - Ranked vessel_id per segment
Pull Request -
State: closed - Opened by pwoods25443 almost 6 years ago
#75 - Ranked vessel_id per segment
Issue -
State: closed - Opened by pwoods25443 almost 6 years ago
- 1 comment
#74 - Remove 'noise' field from vessel_info table schema
Pull Request -
State: closed - Opened by pwoods25443 almost 6 years ago
#73 - There is a spurious field 'noise' in the schema for vessel_info
Issue -
State: closed - Opened by pwoods25443 almost 6 years ago
#72 - Assign distinct vessel_id per segment when spoofing is present
Issue -
State: open - Opened by pwoods25443 almost 6 years ago
#71 - Minimum frequency threshold for most common ident value determination
Pull Request -
State: closed - Opened by pwoods25443 about 6 years ago
- 1 comment
#70 - Deprecate identity_messages_monthly and segment_identity
Issue -
State: open - Opened by pwoods25443 about 6 years ago
#69 - Eliminate 1-time callsigns from vesssel_id
Issue -
State: closed - Opened by pwoods25443 about 6 years ago
- 1 comment
#68 - Bump pipe-tools to 0.1.7
Pull Request -
State: closed - Opened by enriquetuya about 6 years ago
#67 - Remove false IMOs from vessel_id
Issue -
State: open - Opened by pwoods25443 about 6 years ago
#66 - Refactor Segment Identity
Pull Request -
State: closed - Opened by pwoods25443 about 6 years ago
Labels: enhancement
#65 - Refactor segment_identity
Issue -
State: closed - Opened by pwoods25443 about 6 years ago
- 2 comments
#64 - Alt segment_info table
Issue -
State: closed - Opened by pwoods25443 about 6 years ago
- 2 comments
#63 - Good_segments
Issue -
State: open - Opened by pwoods25443 about 6 years ago
- 2 comments
#62 - Release v0.2.4
Issue -
State: closed - Opened by pwoods25443 about 6 years ago
#61 - Include noise flag and message count in segment_info
Pull Request -
State: closed - Opened by pwoods25443 about 6 years ago
- 2 comments
#60 - Include noise factors in segment_info
Issue -
State: closed - Opened by pwoods25443 about 6 years ago
#59 - Parameterize max_num_workers
Pull Request -
State: closed - Opened by pwoods25443 about 6 years ago
- 1 comment