#etl Repositories
Discover 105 active open source GitHub repositories tagged with #etl, accumulating 408,616 total stars (averaging 3,891 stars per project). Leading this topic is pathwaycom/pathway with 61,976 stars.
105 repositories total
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
Open-source data movement for ELT pipelines and AI agents โ from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
An orchestration platform for the development, production, and observation of data assets.
Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
DataX integrated visualization page: Select a data source to generate data synchronization tasks with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, MongoDB, etc. Batch creation of RDBMS data synchronization tasks, integration with open-source scheduling systems, support for distributed processing, incremental data synchronization, real-time viewing of running logs, monitoring executor resources, KILL running processes, data source information encryption, and more.
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Scalable and efficient data transformation framework - backwards compatible with dbt.
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
The fastest unified streaming SQL engine in a single C++ binary. โก Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
Actively curated list of awesome BI tools. PRs welcome!
OLake Go: open-source replication from databases, Kafka, and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
The best place to learn data engineering. Built and maintained by the data engineering community.
๐ฅ๐ฅ๐ฅ Open source Reverse ETL - alternative to hightouch and census.
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
Open-source ETL/ELT that you deploy on your own servers or in the cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, and MCP for AI agents. No vendor cloud, no per-row billing.
The open document intelligence platform for builders and hackers - DMS for the agentic world
Actively maintained successor to Alibaba DataX โ a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
Frequently Asked Questions
What is the most popular #etl repository on GitHub?
The top ranked open source #etl project on GitHub is pathwaycom/pathway with 61,976 stars. Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Which programming languages are most used in #etl repositories?
Among the top ranked #etl projects on GitHub, the most common programming languages are Python, Java, Go, Rust.
How is the #etl repository ranking calculated?
We track 105 active open source repositories tagged with #etl (500+ stars), totaling 408,616 stars with an average of 3,891 stars per repository. Rankings update daily from the GitHub API.