e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

postgresql

View on GitHub Website

323 Stars

146 Forks

323 Watchers

Python Language

100 SrcLog Score

Cost to Build

$10.1K

Market Value

$28.2K

How is this calculated?

Growth over time

2 data points · 2025-09-22 → 2026-04-13

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about e2e-data-engineering

Question copied to clipboard

What is the airscholar/e2e-data-engineering GitHub project? Description: "An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone e2e-data-engineering

Clone via HTTPS

git clone https://github.com/airscholar/e2e-data-engineering.git

Clone via SSH

[email protected]:airscholar/e2e-data-engineering.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the e2e-data-engineering issue tracker:

Open GitHub Issues

Similar to e2e-data-engineering

sequelize Qix postgrest metabase redash knex typeorm pgcli node-postgres dbeaver timescaledb pgweb bookshelf NewsBlur awesome-postgres backup usql dev-setup bolt xorm react-firebase-starter franchise adminer diesel node-orm2 citus asyncpg wal-e massive-js formspree