aws/amazon-mwaa-docker-images issues and pull requests

#100 - Fix auto-scaling service metrics

Pull Request - State: closed - Opened by rafidka 3 months ago

#99 - Apply the necessary Airflow configuration on the top process itself (entrypoint.py) instead of just child processes.

Issue - State: open - Opened by rafidka 3 months ago

#98 - Fix Metrics Deprecation Warning

Issue - State: open - Opened by rafidka 3 months ago

#97 - Change stream names for requirements/startup + Fix log level

Pull Request - State: closed - Opened by rafidka 3 months ago

#96 - Port the license checking code + Improving Docker build time

Pull Request - State: closed - Opened by rafidka 3 months ago

#95 - Sub-process for `airflow celery stop` + minor changes

Pull Request - State: closed - Opened by rafidka 3 months ago

#94 - Make auto scaling metrics report zero

Pull Request - State: closed - Opened by rafidka 3 months ago

#93 - Minor bug fixes

Pull Request - State: closed - Opened by rafidka 3 months ago

#92 - Extract common functionality from Airflow 2.9.2 code base to avoid duplication

Issue - State: open - Opened by rafidka 3 months ago

#91 - Use essential requirements only if constraints are commented out

Pull Request - State: closed - Opened by rafidka 4 months ago

#90 - Disable log group creation in CloudWatch handlers

Pull Request - State: closed - Opened by rafidka 4 months ago - 3 comments

#89 - Create a process hook for ensuring log groups exist

Issue - State: open - Opened by rafidka 4 months ago

#88 - Update the airflow_constraints.txt file to use 2.9.2

Pull Request - State: closed - Opened by rafidka 4 months ago

#87 - feat: Add webserver config to optionally disable WTF CSRF

Pull Request - State: closed - Opened by reganbaum 4 months ago

#86 - dag_stats fails in v2.9, but not in v2.8

Issue - State: closed - Opened by agupta01 4 months ago - 4 comments

#85 - Improve timeout logging in startup script

Issue - State: open - Opened by rafidka 4 months ago

#84 - Porting auto-scaling internal code

Pull Request - State: closed - Opened by rafidka 4 months ago - 2 comments

#83 - Ensure start-up script finishes in 5 minutes

Pull Request - State: closed - Opened by rafidka 4 months ago

#82 - Improvements to requirements installation + Env vars fix

Pull Request - State: closed - Opened by rafidka 4 months ago

#81 - Add virtualenv to list of required pip packages

Pull Request - State: closed - Opened by jessefrn1 4 months ago

#80 - Protect required environment variables

Pull Request - State: closed - Opened by jessefrn1 4 months ago

#79 - Add apache-airflow-providers-postgres to list of required pip packages

Pull Request - State: closed - Opened by jessefrn1 4 months ago

#78 - Protect required environment variables. Also add apache-airflow-providers-postgres to pip installations

Pull Request - State: closed - Opened by jessefrn1 4 months ago

#77 - Multiple fixes

Pull Request - State: closed - Opened by rafidka 4 months ago

#76 - Make DB condition informational + Log sniffing

Pull Request - State: closed - Opened by rafidka 4 months ago

#75 - Restart the Airflow container if the DB health condition repeatedly fails

Issue - State: open - Opened by rafidka 4 months ago

#74 - Make 'airflow' a sudoer

Pull Request - State: closed - Opened by rafidka 4 months ago

#73 - Config changes necessary for MWAA Metrics integration

Pull Request - State: closed - Opened by rafidka 4 months ago

#72 - feat: add config to disable sidecar health monitoring

Pull Request - State: closed - Opened by agupta01 4 months ago

#71 - feat: add option for no auth

Pull Request - State: closed - Opened by agupta01 4 months ago - 2 comments

#70 - Upgrade to Airflow v2.9.2

Pull Request - State: closed - Opened by rafidka 4 months ago

#69 - Support essential vs. non-essential config/environ

Pull Request - State: closed - Opened by rafidka 4 months ago

#68 - Add scheduler.schedule_after_task_execution and secrets.backend_kwargs Airflow config defaults

Pull Request - State: closed - Opened by kuyperse 4 months ago

#67 - Optional integration with IAM via MWAA IAM plugin

Pull Request - State: closed - Opened by rafidka 4 months ago

#66 - Health monitoring and auto restart mechanism

Pull Request - State: closed - Opened by rafidka 4 months ago

#65 - fix: checking for empty string log_group_arn

Pull Request - State: closed - Opened by agupta01 4 months ago

#64 - Add startup script support

Pull Request - State: closed - Opened by jessefrn1 4 months ago - 2 comments

#63 - Exit the scheduler container if any sub-process fails

Pull Request - State: closed - Opened by rafidka 4 months ago

#62 - Update README with info on the different Docker images

Pull Request - State: closed - Opened by rafidka 4 months ago

#61 - Support process timeout and use it for reqs install

Pull Request - State: closed - Opened by rafidka 4 months ago

#60 - Generate per-subprocess CPU and memory metrics

Issue - State: open - Opened by rafidka 4 months ago

#59 - Make the DAG processor standalone and add triggerer

Pull Request - State: closed - Opened by rafidka 4 months ago

#58 - Add spell checking tool to quality control tools

Issue - State: open - Opened by rafidka 4 months ago

#57 - Consider using the 'identifier' parameter in TaskLogHandler

Issue - State: open - Opened by rafidka 4 months ago

#56 - Implement integration with CloudWatch Logs

Pull Request - State: closed - Opened by rafidka 4 months ago

#55 - Pass web server log level to gunicorn

Issue - State: closed - Opened by rafidka 4 months ago - 1 comment

#54 - Port local runner utility - resetdb

Pull Request - State: closed - Opened by jessefrn1 4 months ago

#53 - Move to Airflow v2.9.1

Pull Request - State: closed - Opened by rafidka 5 months ago

#52 - venv generation fails when pg_config is not installed.

Issue - State: closed - Opened by dhegberg 5 months ago - 1 comment

#51 - Improve entrypoint logging + Enable StatsD metrics

Pull Request - State: closed - Opened by rafidka 5 months ago

#50 - Bump jinja2 from 3.1.3 to 3.1.4

Pull Request - State: closed - Opened by dependabot[bot] 5 months ago
Labels: dependencies

#49 - Script for pushing images to ECR

Pull Request - State: closed - Opened by rafidka 5 months ago

#48 - Update sslmode to 'require' for enhanced security with Postgres conne…

Pull Request - State: closed - Opened by jessefrn1 5 months ago

#47 - Correct the name of the Airfow v2.9.0 folder + Minor changes + Update README.md file

Pull Request - State: closed - Opened by rafidka 5 months ago

#46 - Port auto scaling-related code

Issue - State: open - Opened by rafidka 5 months ago

#45 - Support the currently existing features in https://github.com/aws/aws-mwaa-local-runner

Issue - State: open - Opened by rafidka 5 months ago - 3 comments

#44 - Verify that we don't need to port the DB version checking code

Issue - State: open - Opened by rafidka 6 months ago

#43 - Add timeout to pip installation and report + report a warning if customer doesn't provide a constraints file

Issue - State: closed - Opened by rafidka 6 months ago

#42 - Automate the generation of Dockerfiles based on the Jinja2 templates

Issue - State: open - Opened by rafidka 6 months ago

#41 - Merging dev-rafidka into main

Pull Request - State: closed - Opened by rafidka 8 months ago

#40 - Changes required to deploy the image using MWAA

Pull Request - State: closed - Opened by rafidka 8 months ago

#39 - Support IAM Integration

Issue - State: closed - Opened by rafidka 8 months ago

#38 - Support installing custom user pip requirements

Pull Request - State: closed - Opened by rafidka 8 months ago

#37 - Improve development experience

Pull Request - State: closed - Opened by rafidka 8 months ago

#36 - Do not use unsupported Python versions/Remove Amazon Linux 2 Support

Issue - State: open - Opened by rafidka 8 months ago

#35 - Mechanism to ensure no more Bash scripts are implmemented without approval

Issue - State: open - Opened by rafidka 8 months ago

#34 - Disallow the direct use of `pip install`

Pull Request - State: closed - Opened by rafidka 8 months ago

#33 - Implement `safe-pip-install` command

Pull Request - State: closed - Opened by rafidka 8 months ago

#32 - Extract common stuff from the different Dockerfiles

Pull Request - State: closed - Opened by rafidka 8 months ago

#31 - Deploy the Open Source Docker Image Internally

Issue - State: closed - Opened by rafidka 8 months ago

#30 - Support 'explorer' and 'dev' images

Pull Request - State: closed - Opened by rafidka 8 months ago

#29 - Docker Compose setup for Airflow 2.8.0

Pull Request - State: closed - Opened by rafidka 8 months ago

#28 - Enforce sslmode=require for Postgres database

Issue - State: closed - Opened by rafidka 8 months ago - 1 comment

#27 - Support optional bootstrapping steps for development purposes

Issue - State: closed - Opened by rafidka 8 months ago

#26 - Only expose port 8008 for the web server

Issue - State: open - Opened by rafidka 8 months ago

#25 - Support a local CloudWatch Metrics server for the Docker Compose setup

Issue - State: open - Opened by rafidka 8 months ago

#24 - Support a local CloudWatch Logs server for the Docker Compose setup

Issue - State: open - Opened by rafidka 8 months ago

#23 - Support a local SQS server for the Docker Compose setup

Issue - State: closed - Opened by rafidka 8 months ago

#22 - Docker Compose setup for Airflow 2.8.0

Pull Request - State: closed - Opened by rafidka 8 months ago - 4 comments

#21 - Remove/Disable pip after successfully installing user requirements

Issue - State: open - Opened by rafidka 8 months ago

#20 - Implement a version verification script in the entrypoint for the critical Python packages

Issue - State: closed - Opened by rafidka 8 months ago - 1 comment

#19 - Early code for Airflow v2.8.0 Docker image

Pull Request - State: closed - Opened by rafidka 9 months ago

#18 - Implement `safe-pip-install` command

Issue - State: closed - Opened by rafidka 9 months ago

#17 - Enforce a mechanism for pip installations that protects Airflow packages

Issue - State: closed - Opened by rafidka 10 months ago

#16 - Health Check Scripts

Issue - State: closed - Opened by rafidka 10 months ago

#15 - Versions Verification Script

Issue - State: closed - Opened by rafidka 10 months ago - 1 comment

#14 - Install Customer requirements.txt

Issue - State: closed - Opened by rafidka 10 months ago

#13 - Licenses Check

Issue - State: closed - Opened by rafidka 10 months ago

#12 - Startup Scripts Support

Issue - State: closed - Opened by rafidka 10 months ago

#11 - Customize Airflow Configuration to Match Amazon MWAA

Issue - State: closed - Opened by rafidka 10 months ago

#10 - Database Validation Tools

Issue - State: open - Opened by rafidka 10 months ago

#9 - Custom SQS Broker for Celery

Issue - State: closed - Opened by rafidka 10 months ago - 1 comment

#8 - CloudWatch Metrics Integration

Issue - State: closed - Opened by rafidka 10 months ago - 1 comment

#7 - CloudWatch Logs Integration

Issue - State: closed - Opened by rafidka 10 months ago

#6 - Initial Docker Compose setup for Airflow v2.8.x/v2.9.x

Issue - State: closed - Opened by rafidka 10 months ago

#5 - Update issue templates

Pull Request - State: closed - Opened by rafidka 10 months ago

#4 - Configure pre-commit

Pull Request - State: closed - Opened by rafidka 10 months ago

#3 - Execute autopep8 as a pre-commit

Issue - State: closed - Opened by rafidka 10 months ago

#2 - Configure pre-commit to help with code automation

Issue - State: closed - Opened by rafidka 10 months ago

#1 - Update README and introduce linting

Pull Request - State: closed - Opened by rafidka 10 months ago - 2 comments

GitHub / aws/amazon-mwaa-docker-images issues and pull requests