snowplow/emr-etl-runner issues and pull requests

#87 - Bump addressable from 2.7.0 to 2.8.1

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago
Labels: dependencies

#86 - Bump jmespath from 1.4.0 to 1.6.1

Pull Request - State: open - Opened by dependabot[bot] over 2 years ago
Labels: dependencies

#85 - Bump nokogiri from 1.10.9 to 1.12.5

Pull Request - State: open - Opened by dependabot[bot] over 3 years ago
Labels: dependencies

#84 - Bump addressable from 2.7.0 to 2.8.0

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#83 - Bump nokogiri from 1.10.9 to 1.11.5

Pull Request - State: closed - Opened by dependabot[bot] over 3 years ago - 1 comment
Labels: dependencies

#82 - Do not submit RDB Loader step if messageQueue is present in Redshift config

Issue - State: open - Opened by chuwy about 4 years ago

#81 - Release/1.0.4

Pull Request - State: closed - Opened by benjben over 4 years ago

#80 - Update config.yml with latest recommended settings

Pull Request - State: closed - Opened by benjben over 4 years ago

#79 - Update config.yml with latest recommended settings

Issue - State: closed - Opened by chuwy over 4 years ago

#78 - Not add/add S3DistCp for shredded JSONs and shredded TSVs depending on the configuration

Pull Request - State: closed - Opened by benjben over 4 years ago - 2 comments

#77 - Disable retry on failure of the rdb_load step

Pull Request - State: closed - Opened by istreeter over 4 years ago

#76 - Disable retry on failure of the rdb_load step

Issue - State: closed - Opened by istreeter over 4 years ago

#75 - Release/1.0.2

Pull Request - State: closed - Opened by istreeter over 4 years ago

#74 - Fix ParamContractError when copying shredded types to S3

Issue - State: closed - Opened by istreeter over 4 years ago

#73 - Release/1.0.1

Pull Request - State: closed - Opened by istreeter over 4 years ago

#72 - Undefined local variable bug

Issue - State: closed - Opened by istreeter over 4 years ago
Labels: bug

#71 - Not add/add S3DistCp for shredded JSONs and shredded TSVs depending on the configuration

Issue - State: closed - Opened by chuwy over 5 years ago - 4 comments

#70 - EmrEtlRunner: Catch and retry EMR connection issues

Issue - State: closed - Opened by istreeter over 4 years ago - 1 comment

#69 - Allow a valid AZ in the given region to be chosen at random in config.yml

Issue - State: open - Opened by alexanderdean over 11 years ago - 4 comments

#68 - Release/1.0.0 rc1

Pull Request - State: closed - Opened by istreeter over 4 years ago

#67 - Release/1.0.0

Pull Request - State: closed - Opened by istreeter over 4 years ago

#66 - Release 0.38.1

Pull Request - State: closed - Opened by peel over 4 years ago

#65 - Fix default diplomat arguments

Issue - State: closed - Opened by peel over 4 years ago

#64 - Release 0.39.0

Pull Request - State: closed - Opened by istreeter over 4 years ago

#63 - Handle step failures by resubmitting the jobflow

Issue - State: closed - Opened by istreeter over 4 years ago

#62 - Extend copyright to 2020

Issue - State: closed - Opened by peel over 4 years ago

#61 - Make EmrEtlRunner and StorageLoader partition all data (incl. in processing buckets) by run_id

Issue - State: open - Opened by alexanderdean almost 12 years ago

#60 - Add new warning bucket to EmrEtlRunner

Issue - State: open - Opened by alexanderdean over 11 years ago

#59 - EmrEtlRunner: add new :etl:collector_format, s3-access-log

Issue - State: open - Opened by alexanderdean over 10 years ago

#58 - Support IAM roles

Issue - State: open - Opened by smugryan about 10 years ago - 10 comments

#57 - EmrEtlRunner: allow config.yml and enrichments to be loaded from DynamoDB

Issue - State: open - Opened by alexanderdean about 10 years ago - 1 comment

#56 - EmrEtlRunner: add --input to configure input format

Issue - State: open - Opened by alexanderdean about 10 years ago

#55 - EmrEtlRunner: add http/ prefix to clj-tomcat, cloudfront, thrift

Issue - State: open - Opened by alexanderdean almost 10 years ago

#54 - EmrEtlRunner: .lzo.index and .lzo separated during copy?

Issue - State: open - Opened by alexanderdean almost 10 years ago

#53 - EmrEtlRunner: improve error message for contract-failing configuration files

Issue - State: open - Opened by fblundun over 9 years ago - 5 comments

#52 - EmrEtlRunner: explore config.yml validation against schema to produce meaningful errors

Issue - State: open - Opened by chuwy almost 9 years ago - 2 comments

#51 - EmrEtlRunner: create shared path for /enriched-events and /nd-jsons across HDFS and S3

Issue - State: open - Opened by yalisassoon almost 9 years ago

#50 - EmrEtlRunner: add ability to retrieve AWS credentials from EC2 role

Issue - State: open - Opened by alexanderdean almost 9 years ago - 2 comments

#49 - EmrEtlRunner: decide what to do with software: section in config.yml

Issue - State: closed - Opened by alexanderdean almost 9 years ago - 3 comments
Labels: wontfix

#48 - EmrEtlRunner: document recovery for elasticsearch on duplicate bad data post emr rerun

Issue - State: open - Opened by ihortom almost 9 years ago

#47 - EmrEtlRunner: placeholder for adding support for the Kafka-to-S3 archival storage format

Issue - State: open - Opened by alexanderdean over 8 years ago

#46 - EmrEtlRunner: Explore possibility of controlled (limited) intake of raw events

Issue - State: open - Opened by ihortom over 8 years ago

#45 - EmrEtlRunner: investigate bumping the open files limit on EMR

Issue - State: open - Opened by alexanderdean over 8 years ago

#44 - EmrEtlRunner: replace Gemfile and Bundler with JRuby/Gradle

Issue - State: open - Opened by alexanderdean over 8 years ago - 2 comments

#43 - EmrEtlRunner/StorageLoader: support LZO compression for enriched events?

Issue - State: open - Opened by alexanderdean over 8 years ago

#42 - EmrEtlRunner: add config.yml lint

Issue - State: closed - Opened by chuwy over 7 years ago - 4 comments
Labels: wontfix

#41 - EmrEtlRunner: enable `generate` command

Issue - State: open - Opened by BenFradet over 7 years ago

#40 - EmrEtlRunner: add RDB Loader step when generating playbooks

Issue - State: open - Opened by BenFradet over 7 years ago

#39 - EmrEtlRunner: support Spark jobs when generating playbooks

Issue - State: open - Opened by BenFradet over 7 years ago

#38 - EmrEtlRunner: add option to lint storage targets

Issue - State: open - Opened by BenFradet over 7 years ago

#37 - EmrEtlRunner: remove bootstrap action fixing common-codecs dependency for AMI 5+

Issue - State: open - Opened by chuwy about 7 years ago - 8 comments

#36 - EmrEtlRunner: drop support for the Scalding-based pipeline

Issue - State: open - Opened by BenFradet over 7 years ago - 3 comments

#35 - EmrEtlRunner: refuse to pass outdated storage target configurations to RDB Loader

Issue - State: open - Opened by chuwy over 7 years ago - 4 comments

#34 - EmrEtlRunner: short-circuit on EMR INTERNAL_ERROR

Issue - State: open - Opened by BenFradet about 7 years ago - 1 comment

#33 - EmrEtlRunner: add support of RDB Loader 0.15.0

Issue - State: open - Opened by chuwy about 7 years ago - 1 comment

#32 - EmrEtlRunner: consider supporting spot instances

Issue - State: open - Opened by BenFradet almost 7 years ago - 1 comment

#31 - intermittent S3DistCp failures

Issue - State: open - Opened by leonmaas almost 7 years ago - 1 comment

#30 - EmrEtlRunner: delete enrich.versions from stream_config.yml.sample

Issue - State: open - Opened by chuwy almost 7 years ago

#29 - EmrEtlRunner: find further memory optimisations

Issue - State: open - Opened by alexanderdean over 6 years ago - 2 comments

#28 - EmrEtlRunner: replace elasticity by the aws-sdk

Issue - State: open - Opened by BenFradet almost 6 years ago - 1 comment

#27 - EmrEtlRunner: bump transient dependency nokogiri to ~> 1.8.5

Issue - State: open - Opened by BenFradet almost 6 years ago

#26 - EmrEtlRunner: bump transient dependency rubyzip to ~> 1.2.2

Issue - State: open - Opened by BenFradet almost 6 years ago

#25 - EmrEtlRunner: add support for emitting Jobflow spec as custom context

Issue - State: open - Opened by jbeemster almost 6 years ago - 1 comment

#24 - EmrEtlRunner: make format options more explicit in config example

Issue - State: open - Opened by jbeemster almost 6 years ago

#23 - EmrEtlRunner: investigate possibility of deploying cluster across multiple subnets and AZs

Issue - State: open - Opened by jbeemster almost 6 years ago

#22 - EmrEtlRunner: do not fail if there is only bad data

Issue - State: open - Opened by BenFradet almost 6 years ago

#21 - EmrEtlRunner: add support of EVENTS_MANIFEST purpose for storage targets

Issue - State: open - Opened by chuwy almost 6 years ago

#20 - EmrEtlRunner: update initialization logic for "Shredded JSON/TSV types HDFS -> S3" steps

Issue - State: closed - Opened by stdfalse over 5 years ago - 4 comments

#19 - EmrEtlRunner: Allow ec2_key_name to be undefined in config

Issue - State: open - Opened by istreeter almost 5 years ago

#18 - EmrEtlRunner: Adding arguments to bootstrap actions

Issue - State: open - Opened by GabeL7r almost 5 years ago

#17 - EmrEtlRunner: set master_instance_type and core_instance_type to m4.medium in example config

Issue - State: open - Opened by benjben over 4 years ago

#16 - Bump upstream dependencies

Issue - State: closed - Opened by peel over 4 years ago

#15 - Bump rest-client to 1.8.0

Issue - State: closed - Opened by peel over 4 years ago

#14 - Bump diplomat to 2.4.0

Issue - State: closed - Opened by peel over 4 years ago

#13 - Bump aws-sdk-s3 to 1.66.0

Issue - State: closed - Opened by peel over 4 years ago

#12 - Bump iglu-ruby-client to 0.2.0

Issue - State: closed - Opened by peel over 4 years ago

#12 - Bump iglu-ruby-client to 0.2.0

Issue - State: closed - Opened by peel over 4 years ago

#11 - Bump snowplow-tracker to 0.6.1

Issue - State: closed - Opened by peel over 4 years ago

#10 - Bump awrence to 1.1.1

Issue - State: closed - Opened by peel over 4 years ago

#9 - Bump avro to 1.9.2

Issue - State: closed - Opened by peel over 4 years ago

#8 - Bump rspec to 3.9.0

Issue - State: closed - Opened by peel over 4 years ago

#7 - Bump jruby to 9.2.11.1

Issue - State: closed - Opened by peel over 4 years ago

#6 - Release 0.38.0

Pull Request - State: closed - Opened by peel over 4 years ago

#5 - Catch and retry EMR connection issues (closes #4)

Pull Request - State: closed - Opened by istreeter over 4 years ago

#4 - Catch and retry EMR connection issues

Issue - State: closed - Opened by istreeter over 4 years ago

#4 - Catch and retry EMR connection issues

Issue - State: closed - Opened by istreeter over 4 years ago

#3 - Add travis configuration

Issue - State: closed - Opened by peel over 4 years ago

#2 - Bump nokogiri from 1.8.2 to 1.10.9

Pull Request - State: closed - Opened by dependabot[bot] over 4 years ago - 1 comment
Labels: dependencies

#1 - Bump excon from 0.62.0 to 0.73.0

Pull Request - State: closed - Opened by dependabot[bot] over 4 years ago - 1 comment
Labels: dependencies

GitHub / snowplow/emr-etl-runner issues and pull requests