This repo contains the DAGs that run on my local Airflow environment. I use the local environment to test my DAGs before deploying them to virtual machines via Kubernetes
-
Updated
Oct 30, 2022 - Python
This repo contains the DAGs that run on my local Airflow environment. I use the local environment to test my DAGs before deploying them to virtual machines via Kubernetes
Your extensible development environment for data projects with Apache Airflow.
Data pipelines created and monitored using Airflow to feed data into Redshift
<!-- This space is dedicated to learning and showcasing the capabilities of Airflow. I hope to provide a fun and engaging environment for exploring all that Airflow has to offer. Join me on this journey of discovery! -->
Serverless Data Processing with Dataflow - CI/CD with Dataflow.
A small dag workflow I created using Apache Airflow
A repository template for data projects with IAC, CI/CD, data migrations, and testing.
ETL Pipeline : Extract and Transform from sushiscan.su - Load in MongoDB Database
A web services based app
Dagster Directed Acyclic Graphs (DAGs) through Dagster with a simple Machine Learning Program.
Add a description, image, and links to the dags topic page so that developers can more easily learn about it.
To associate your repository with the dags topic, visit your repo's landing page and select "manage topics."