Git Stars Git Stars

#etl Repositories

Discover 105 active open source GitHub repositories tagged with #etl, accumulating 408,616 total stars (averaging 3,891 stars per project). Leading this topic is pathwaycom/pathway with 61,976 stars.

105
Total Repositories
408,616
Total Stars
3,891
Avg Stars/Repo
1
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

pathwaycom
โญ 61,976 Python ๐Ÿ‘ค pathwaycom Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-11-27
2
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

apache
โญ 47,583 Python ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-04-13
3
kestra-io/kestra

Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.

kestra-io
โญ 30,303 Java ๐Ÿ‘ค kestra-io Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-08-24
4
vectordotdev/vector

A high-performance observability data pipeline.

vectordotdev
โญ 22,928 Rust ๐Ÿ‘ค vectordotdev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-08-27
5
airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents โ€” from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

airbytehq
โญ 22,426 Python ๐Ÿ‘ค airbytehq Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-07-27
6
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

dagster-io
โญ 16,453 Python ๐Ÿ‘ค dagster-io Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-04-30
7
cocoindex-io/cocoindex

Incremental engine for long horizon agents ๐ŸŒŸ Star if you like it!

cocoindex-io
โญ 11,923 Rust ๐Ÿ‘ค cocoindex-io Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-03-03
8
mage-ai/mage-ai

๐Ÿง™ Build, run, and manage data pipelines for integrating and transforming data.

mage-ai
โญ 8,850 Python ๐Ÿ‘ค mage-ai Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2022-05-16
9
redpanda-data/connect

Fancy stream processing made operationally mundane

redpanda-data
โญ 8,804 Go ๐Ÿ‘ค redpanda-data Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-03-22
10
pentaho/pentaho-kettle

Pentaho Data Integration (ETL) a.k.a Kettle

pentaho
โญ 8,419 Java ๐Ÿ‘ค pentaho Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2013-10-08
11
turbot/steampipe

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

turbot
โญ 8,019 Go ๐Ÿ‘ค turbot Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2021-01-17
12
cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

cloudquery
โญ 6,561 Go ๐Ÿ‘ค cloudquery Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-11-18
13
apache/flink-cdc

Flink CDC is a streaming data integration tool

apache
โญ 6,495 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2020-07-27
14
WeiYe-Jing/datax-web

DataX integrated visualization page: Select a data source to generate data synchronization tasks with one click. Supports data sources such as RDBMS, Hive, HBase, ClickHouse, MongoDB, etc. Batch creation of RDBMS data synchronization tasks, integration with open-source scheduling systems, support for distributed processing, incremental data synchronization, real-time viewing of running logs, monitoring executor resources, KILL running processes, data source information encryption, and more.

WeiYe-Jing
โญ 5,958 Java ๐Ÿ‘ค WeiYe-Jing User ๐Ÿ• Updated 2024-06-02 ๐Ÿ“… Created 2019-11-19
15
Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Eventual-Inc
โญ 5,858 Rust ๐Ÿ‘ค Eventual-Inc Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2022-04-25
16
rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

rudderlabs
โญ 4,520 Go ๐Ÿ‘ค rudderlabs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-07-19
17
zendesk/maxwell

Maxwell's daemon, a mysql-to-json kafka producer

zendesk
โญ 4,268 Java ๐Ÿ‘ค zendesk Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2015-02-09
18
ucbepic/docetl

A system for agentic LLM-powered data processing and ETL

ucbepic
โญ 4,266 Python ๐Ÿ‘ค ucbepic Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2024-07-09
19
aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

aws
โญ 4,124 Python ๐Ÿ‘ค aws Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-02-26
20
quadratichq/quadratic

Spreadsheet with AI, Code, Connections

quadratichq
โญ 3,958 Rust ๐Ÿ‘ค quadratichq Organization ๐Ÿ• Updated 2026-03-07 ๐Ÿ“… Created 2021-11-11
21
Netflix/maestro

Maestro: Netflixโ€™s Workflow Orchestrator

Netflix
โญ 3,852 Java ๐Ÿ‘ค Netflix Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2024-04-17
22
pawl/awesome-etl

A curated list of awesome ETL frameworks, libraries, and software.

pawl
โญ 3,607 ๐Ÿ‘ค pawl User ๐Ÿ• Updated 2026-05-01 ๐Ÿ“… Created 2015-10-07
23
xyflow/awesome-node-based-uis

A curated list with resources about node-based UIs

xyflow
โญ 3,599 ๐Ÿ‘ค xyflow Organization ๐Ÿ• Updated 2025-06-29 ๐Ÿ“… Created 2022-11-14
24
SQLMesh/sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

SQLMesh
โญ 3,360 Python ๐Ÿ‘ค SQLMesh Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-09-23
25
PeerDB-io/peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

PeerDB-io
โญ 3,322 Go ๐Ÿ‘ค PeerDB-io Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-04-15
26
duckdb/pg_duckdb

DuckDB-powered Postgres for high performance apps & analytics.

duckdb
โญ 3,317 C++ ๐Ÿ‘ค duckdb Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2024-03-20
27
apache/devlake

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.

apache
โญ 3,204 Go ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2021-07-08
28
blockchain-etl/ethereum-etl

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

blockchain-etl
โญ 3,132 Python ๐Ÿ‘ค blockchain-etl Organization ๐Ÿ• Updated 2026-01-25 ๐Ÿ“… Created 2018-05-02
29
apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

apache
โญ 2,631 Jupyter Notebook ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2023-02-23
30
instill-ai/instill-core

Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

instill-ai
โญ 2,322 Python ๐Ÿ‘ค instill-ai Organization ๐Ÿ• Updated 2026-06-01 ๐Ÿ“… Created 2022-01-13
31
timeplus-io/proton

The fastest unified streaming SQL engine in a single C++ binary. โšก Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

timeplus-io
โญ 2,286 C++ ๐Ÿ‘ค timeplus-io Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-08-14
32
thenaturalist/awesome-business-intelligence

Actively curated list of awesome BI tools. PRs welcome!

thenaturalist
โญ 2,252 ๐Ÿ‘ค thenaturalist User ๐Ÿ• Updated 2024-08-21 ๐Ÿ“… Created 2017-06-08
33
reugn/go-streams

A lightweight stream processing library for Go

reugn
โญ 2,178 Go ๐Ÿ‘ค reugn User ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2019-04-30
34
datazip-inc/olake-go

OLake Go: open-source replication from databases, Kafka, and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

datazip-inc
โญ 2,166 Go ๐Ÿ‘ค datazip-inc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-15
35
data-engineering-community/data-engineering-wiki

The best place to learn data engineering. Built and maintained by the data engineering community.

data-engineering-community
โญ 2,067 CSS ๐Ÿ‘ค data-engineering-community Organization ๐Ÿ• Updated 2026-09-15 ๐Ÿ“… Created 2021-05-04
36
TurboWay/big_screen

Big screen data visualization

TurboWay
โญ 1,884 HTML ๐Ÿ‘ค TurboWay User ๐Ÿ• Updated 2026-01-22 ๐Ÿ“… Created 2020-09-28
37
dbt-labs/dbt-utils

Utility functions for dbt projects.

dbt-labs
โญ 1,837 Makefile ๐Ÿ‘ค dbt-labs Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2017-07-16
38
shuchkin/simplexlsx

Parse and retrieve data from Excel XLSx files

shuchkin
โญ 1,829 PHP ๐Ÿ‘ค shuchkin User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2016-05-25
39
thbar/kiba

Data processing & ETL framework for Ruby

thbar
โญ 1,775 Ruby ๐Ÿ‘ค thbar User ๐Ÿ• Updated 2026-01-10 ๐Ÿ“… Created 2013-07-18
40
Multiwoven/multiwoven

๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ Open source Reverse ETL - alternative to hightouch and census.

Multiwoven
โญ 1,685 Ruby ๐Ÿ‘ค Multiwoven Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-10-20
41
Snowflake-Labs/pg_lake

pg_lake: Postgres with Iceberg and data lake access

Snowflake-Labs
โญ 1,674 Python ๐Ÿ‘ค Snowflake-Labs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2025-11-04
42
yobix-ai/extractous

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

yobix-ai
โญ 1,660 Rust ๐Ÿ‘ค yobix-ai Organization ๐Ÿ• Updated 2024-12-21 ๐Ÿ“… Created 2024-06-04
43
ariacom/Seal-Report

Database Reporting Tool and Tasks (.Net)

ariacom
โญ 1,647 C# ๐Ÿ‘ค ariacom User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-08-11
44
nerevu/riko

A Python stream processing engine modeled after Yahoo! Pipes

nerevu
โญ 1,605 Python ๐Ÿ‘ค nerevu Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2016-06-02
45
getdozer/dozer

Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.

getdozer
โญ 1,571 Rust ๐Ÿ‘ค getdozer Organization ๐Ÿ• Updated 2024-06-18 ๐Ÿ“… Created 2022-08-31
46
slothflowlabs/duckle

Open-source ETL/ELT that you deploy on your own servers or in the cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 446 components, dbt, CDC, data quality, reverse ETL, lineage, and MCP for AI agents. No vendor cloud, no per-row billing.

slothflowlabs
โญ 1,558 Rust ๐Ÿ‘ค slothflowlabs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2026-05-21
47
Open-Source-Legal/OpenContracts

The open document intelligence platform for builders and hackers - DMS for the agentic world

Open-Source-Legal
โญ 1,550 Python ๐Ÿ‘ค Open-Source-Legal Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-10-24
48
apache/hop

Hop Orchestration Platform

apache
โญ 1,544 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-09-24
49
duneanalytics/spellbook

SQL views for Dune

duneanalytics
โญ 1,529 Python ๐Ÿ‘ค duneanalytics Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2020-01-31
50
wgzhao/Addax

Actively maintained successor to Alibaba DataX โ€” a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.

wgzhao
โญ 1,455 Java ๐Ÿ‘ค wgzhao User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-07-17

Frequently Asked Questions

1

What is the most popular #etl repository on GitHub?

The top ranked open source #etl project on GitHub is pathwaycom/pathway with 61,976 stars. Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

2

Which programming languages are most used in #etl repositories?

Among the top ranked #etl projects on GitHub, the most common programming languages are Python, Java, Go, Rust.

3

How is the #etl repository ranking calculated?

We track 105 active open source repositories tagged with #etl (500+ stars), totaling 408,616 stars with an average of 3,891 stars per repository. Rankings update daily from the GitHub API.