m-lab/stats-pipeline issues and pull requests

#119 - Update cloudbuild.yaml

Pull Request - State: closed - Opened by robertodauria 10 months ago

#118 - Updates nodeSelector for deployments

Pull Request - State: closed - Opened by nkinkade 11 months ago

#117 - Fix unit tests

Pull Request - State: closed - Opened by robertodauria about 1 year ago

#116 - Update go version to 1.20

Pull Request - State: closed - Opened by cristinaleonr about 1 year ago
Labels: fixit2023

#115 - Update m-lab/go to v0.1.66

Pull Request - State: closed - Opened by robertodauria about 1 year ago
Labels: fixit2023

#114 - Rename data-pipeline configurations (us-central1 migration)

Pull Request - State: closed - Opened by stephen-soltesz about 1 year ago
Labels: fixit2023

#113 - Bump golang.org/x/sys from 0.0.0-20210603081109-ebe580a85c40 to 0.1.0

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#112 - Bump golang.org/x/net from 0.0.0-20200927032502-5d4f70055728 to 0.7.0

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#111 - Bump golang.org/x/text from 0.3.3 to 0.3.8

Pull Request - State: open - Opened by dependabot[bot] over 1 year ago - 1 comment
Labels: dependencies, go

#110 - Bump github.com/prometheus/client_golang from 1.11.0 to 1.11.1

Pull Request - State: open - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, go

#109 - Bump qs from 6.5.2 to 6.5.3 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] almost 2 years ago - 1 comment
Labels: dependencies, javascript

#108 - Bump minimatch from 3.0.4 to 3.1.2 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies, javascript

#107 - Bump d3-color and d3 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] about 2 years ago - 1 comment
Labels: dependencies, javascript

#106 - Upgrade repo to Go 1.18

Pull Request - State: closed - Opened by SaiedKazemi over 2 years ago - 1 comment
Labels: fixit2022

#105 - Bump tar and sqlite3 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies, javascript

#104 - Bump minimist and wget-improved in /maptiles

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies, javascript

#103 - Bump mixme from 0.4.0 to 0.5.4 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies, javascript

#102 - Bump json-schema from 0.2.3 to 0.4.0 in /maptiles

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago - 1 comment
Labels: dependencies, javascript

#101 - Bump sqlite3 from 5.0.0 to 5.0.3 in /maptiles

Pull Request - State: closed - Opened by dependabot[bot] over 2 years ago - 2 comments
Labels: dependencies, javascript

#100 - Use batch/v1 API

Pull Request - State: closed - Opened by stephen-soltesz over 2 years ago - 1 comment

#99 - Modify hopannotation1 formatter to include paris-traceroute data

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 1 comment
Labels: traceroute

#98 - Remove undesired new lines in table

Pull Request - State: open - Opened by chrowe almost 3 years ago - 1 comment

#97 - Deploy hopannotation1-export

Issue - State: closed - Opened by cristinaleonr almost 3 years ago - 4 comments

#96 - Decrease workers for hopannotation1 export

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 1 comment
Labels: traceroute

#95 - 1

Issue - State: closed - Opened by mike22664 almost 3 years ago

#94 - DRAFT: unfinished logic for writewait

Pull Request - State: closed - Opened by stephen-soltesz almost 3 years ago - 1 comment

#93 - Use cron job for hopannotation1 export

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 3 comments
Labels: traceroute

#92 - Add k8s configuration for hopannotation1-export

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 1 comment
Labels: traceroute

#91 - Add hopannotation1 formatter

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 1 comment
Labels: traceroute

#90 - Add hopannotation1 formatter

Pull Request - State: closed - Opened by cristinaleonr almost 3 years ago - 1 comment
Labels: traceroute

#89 - Test context cancelation and increase coverage

Pull Request - State: closed - Opened by robertodauria almost 3 years ago - 1 comment

#88 - Fix races in export_test.go

Pull Request - State: closed - Opened by robertodauria about 3 years ago - 1 comment

#87 - Add separate CronJob for annotation-export

Pull Request - State: closed - Opened by robertodauria about 3 years ago - 1 comment

#86 - Standardize service account roles for stats-pipeline node pool

Issue - State: open - Opened by stephen-soltesz about 3 years ago - 1 comment
Labels: review/triage

#85 - Deploy annotation-export

Issue - State: closed - Opened by stephen-soltesz about 3 years ago - 6 comments

#84 - Request less CPU for pusher

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#83 - Different default cluster services make annotation-export unschedulable in staging

Issue - State: closed - Opened by stephen-soltesz about 3 years ago

#82 - Add k8s configuration for annotation-export

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#81 - Prepare for a k8s configuration and deployment

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#80 - consider ways to segment statistics by provider access media

Issue - State: open - Opened by critzo about 3 years ago
Labels: review/triage

#79 - Change Formatter.Where to .Partition w/ exporter query updates

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#78 - Change canary query to use simpler client filter

Pull Request - State: closed - Opened by gfr10598 about 3 years ago - 1 comment

#77 - Add annotation export config for local development

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 2 comments

#76 - Add "annotation" formatter

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 3 comments

#75 - Update exporter to use Formatter interface

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#74 - Add stats query formatter

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#73 - Update us centric queries. Completes #71

Pull Request - State: open - Opened by critzo about 3 years ago - 1 comment

#72 - Add exporter type flag and base for annotation export

Pull Request - State: closed - Opened by stephen-soltesz about 3 years ago - 1 comment

#71 - Add additional fields to support NTIA, and to simplify M-Lab DataStudio report queries

Issue - State: open - Opened by critzo about 3 years ago - 1 comment
Labels: review/triage

#70 - update two subqueries that had the wrong table name

Pull Request - State: closed - Opened by critzo about 3 years ago

#69 - Replace year with start/end and add canary validation query

Pull Request - State: closed - Opened by robertodauria over 3 years ago - 1 comment

#68 - Make partitioning configurable during the query phase

Pull Request - State: closed - Opened by robertodauria over 3 years ago - 1 comment

#67 - Canary query prototype

Pull Request - State: open - Opened by gfr10598 over 3 years ago - 1 comment

#66 - Add unit tests and coverage for stats-pipeline

Pull Request - State: closed - Opened by stephen-soltesz over 3 years ago

#65 - Add output support option for GCSWriter or LocalWriter

Pull Request - State: closed - Opened by stephen-soltesz over 3 years ago - 1 comment

#63 - publish statistics table views in measurement-lab

Issue - State: closed - Opened by critzo over 3 years ago - 1 comment

#62 - Remove fields filtering from JSON output

Pull Request - State: closed - Opened by robertodauria over 3 years ago

#61 - Change FCC data year from 2019 to 2020

Pull Request - State: closed - Opened by robertodauria over 3 years ago

#60 - Copy config.json over to k8s/data-processing/config/config.json.

Pull Request - State: closed - Opened by robertodauria over 3 years ago

#59 - JSON output should include GEOID where used

Issue - State: open - Opened by critzo over 3 years ago
Labels: feature, community-tools

#58 - Support us territories

Pull Request - State: closed - Opened by critzo over 3 years ago - 9 comments

#57 - Remove extra "asn" field from order by

Pull Request - State: closed - Opened by robertodauria over 3 years ago

#56 - Update region logic

Pull Request - State: closed - Opened by critzo over 3 years ago

#55 - correct us_county queries

Pull Request - State: closed - Opened by critzo over 3 years ago

#54 - add four queries for the European Union standard geographies

Pull Request - State: closed - Opened by critzo over 3 years ago - 1 comment

#53 - Update queries using "region" fields

Pull Request - State: closed - Opened by critzo over 3 years ago - 1 comment

#52 - Create CronJob to run stats-pipeline on GKE

Pull Request - State: closed - Opened by robertodauria over 3 years ago

#51 - Fix EOF detection while iterating BQ rows + add ASN queries

Pull Request - State: closed - Opened by robertodauria almost 4 years ago - 1 comment

#50 - Remove partitioning field when exporting data to JSON

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#49 - Add docs

Pull Request - State: closed - Opened by critzo almost 4 years ago

#48 - Add histogram metric to track bytes used in BQ

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#47 - correct duplicate field names

Pull Request - State: closed - Opened by critzo almost 4 years ago

#46 - Add "shard" field back and remove ORDER BY

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#45 - Apply stats methods from QA review to all remaining queries

Pull Request - State: closed - Opened by critzo almost 4 years ago

#44 - Add "step" parameter to the /pipeline endpoint

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#43 - Replace queue size counter with a histogram.

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#42 - Update continent query with input from latest team quality review

Pull Request - State: closed - Opened by critzo almost 4 years ago - 8 comments

#41 - Allow to specify a date range on the /pipeline endpoint

Issue - State: open - Opened by robertodauria almost 4 years ago
Labels: feature, pipeline, community-tools

#40 - Add .gitignore

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#39 - Add Prometheus metrics to monitor the "export" phase of the pipeline

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#38 - Import maptiles/ folder from Piecewise.

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#37 - Add Dockerfile and package.json

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#36 - determine a better method for grouping "clients" than IP address

Issue - State: open - Opened by critzo almost 4 years ago
Labels: feature, pipeline, community-tools

#35 - Include analyses/aggregates for peak and non-peak or business/non-business hours

Issue - State: open - Opened by critzo almost 4 years ago - 1 comment
Labels: feature, pipeline, community-tools

#34 - Include confidence intervals

Issue - State: open - Opened by critzo almost 4 years ago
Labels: roadmap

#33 - Write user documentation

Issue - State: closed - Opened by critzo almost 4 years ago

#32 - Use server-client distance restriction or tuning

Issue - State: open - Opened by critzo almost 4 years ago
Labels: roadmap

#31 - Add stats-pipeline-service

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#30 - Update stats-pipeline queries per data quality team review

Issue - State: closed - Opened by critzo almost 4 years ago - 3 comments

#29 - Draft advisory language for the v0 stats-API release

Issue - State: closed - Opened by critzo almost 4 years ago

#28 - Add Google Cloud Build deployment

Pull Request - State: closed - Opened by robertodauria almost 4 years ago - 1 comment

#27 - Add maptiles generation code and Dockerfile.

Pull Request - State: closed - Opened by robertodauria almost 4 years ago - 1 comment

#26 - add support for additional aggregations by time period and other geographies

Issue - State: open - Opened by critzo almost 4 years ago - 1 comment
Labels: enhancement, P2, backlog

#25 - Add main.go to run the stats-pipeline server.

Pull Request - State: closed - Opened by robertodauria almost 4 years ago

#24 - update queries

Pull Request - State: closed - Opened by critzo almost 4 years ago - 2 comments

#23 - Remove dup fields, use median, old file cleanup

Pull Request - State: closed - Opened by critzo almost 4 years ago - 1 comment

#22 - Add Dockerfile

Pull Request - State: closed - Opened by robertodauria about 4 years ago

#21 - Add the HTTP handler for /v0/pipeline

Pull Request - State: closed - Opened by robertodauria about 4 years ago

#20 - Update queries

Pull Request - State: closed - Opened by robertodauria about 4 years ago

#19 - Exporter package

Pull Request - State: closed - Opened by robertodauria about 4 years ago

GitHub / m-lab/stats-pipeline issues and pull requests