Data Engineering Blogs

Data Engineering Blogs

#airflow

Articles tagged with #airflow

Real Estate Data Pipeline with AWS, Airflow, Snowflake & Power BI
This project implements a scalable data pipeline to extract, transform, and load real estate data from Redfin into Snowflake using AWS services. The data is later visualized in Power BI to provide insights into real estate trends. Overview The pipeli...
Feb 8, 20252 min read7
Weather and S3 Data Integration Pipeline with Apache Airflow on AWS
This project demonstrates an ETL pipeline built with Apache Airflow on an AWS EC2 instance. The pipeline pulls data from the OpenWeather API and Amazon S3, performs transformations, loads the data into an RDS PostgreSQL database, joins the datasets, ...
Feb 8, 20252 min read2