Git Stars Git Stars

#data-ingestion Repositories

Discover 33 active open source GitHub repositories tagged with #data-ingestion, accumulating 66,183 total stars (averaging 2,005 stars per project). Leading this topic is apache/seatunnel with 9,821 stars.

33
Total Repositories
66,183
Total Stars
2,005
Avg Stars/Repo
1
apache/seatunnel

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

apache
โญ 9,821 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2017-08-05
2
weaviate/Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

weaviate
โญ 7,716 Python ๐Ÿ‘ค weaviate Organization ๐Ÿ• Updated 2026-05-11 ๐Ÿ“… Created 2023-07-28
3
DataTalksClub/llm-zoomcamp

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base. Register here ๐Ÿ‘‡๐Ÿผ

DataTalksClub
โญ 7,715 Jupyter Notebook ๐Ÿ‘ค DataTalksClub Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2024-03-26
4
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

bruin-data
โญ 4,049 Go ๐Ÿ‘ค bruin-data Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-02-12
5
apache/paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

apache
โญ 3,454 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-01-12
6
elixir-broadway/broadway

Concurrent and multi-stage data ingestion and data processing with Elixir

elixir-broadway
โญ 2,694 Elixir ๐Ÿ‘ค elixir-broadway Organization ๐Ÿ• Updated 2026-11-06 ๐Ÿ“… Created 2018-11-05
โญ 2,356 C++ ๐Ÿ‘ค ben-strasser User ๐Ÿ• Updated 2025-02-02 ๐Ÿ“… Created 2015-04-15
8
datazip-inc/olake-go

OLake Go: open-source replication from databases, Kafka, and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

datazip-inc
โญ 2,166 Go ๐Ÿ‘ค datazip-inc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-10-15
9
pravega/pravega

Pravega - Streaming as a new software defined storage primitive

pravega
โญ 2,003 Java ๐Ÿ‘ค pravega Organization ๐Ÿ• Updated 2025-03-02 ๐Ÿ“… Created 2016-07-11
10
bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

bruin-data
โญ 1,816 Go ๐Ÿ‘ค bruin-data Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2023-08-03
11
fossasia/eventyay-bitpay

Bitpay integration for eventyay

fossasia
โญ 1,520 Python ๐Ÿ‘ค fossasia Organization ๐Ÿ• Updated 2026-09-29 ๐Ÿ“… Created 2016-07-29
12
mafintosh/csv-parser

Streaming csv parser inspired by binary-csv that aims to be faster than everyone else

mafintosh
โญ 1,503 JavaScript ๐Ÿ‘ค mafintosh User ๐Ÿ• Updated 2026-05-07 ๐Ÿ“… Created 2014-05-16
13
ideal-postcodes/postcodes.io

UK postcode & geolocation API, serving up open data

ideal-postcodes
โญ 1,419 HTML ๐Ÿ‘ค ideal-postcodes Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2014-01-17
14
mps-youtube/pafy

Python library to download YouTube content and retrieve metadata

mps-youtube
โญ 1,403 Python ๐Ÿ‘ค mps-youtube Organization ๐Ÿ• Updated 2024-04-29 ๐Ÿ“… Created 2013-06-24
โญ 1,396 Python ๐Ÿ‘ค SebastienZh User ๐Ÿ• Updated 2026-03-14 ๐Ÿ“… Created 2025-06-16
16
scrapinghub/frontera

A scalable frontier for web crawlers

scrapinghub
โญ 1,329 Python ๐Ÿ‘ค scrapinghub Organization ๐Ÿ• Updated 2025-06-06 ๐Ÿ“… Created 2014-11-22
โญ 1,274 ๐Ÿ‘ค a16z-infra Organization ๐Ÿ• Updated 2024-07-26 ๐Ÿ“… Created 2023-07-27
18
influxdata/influxdb-java

Java client for InfluxDB

influxdata
โญ 1,195 Java ๐Ÿ‘ค influxdata Organization ๐Ÿ• Updated 2026-03-01 ๐Ÿ“… Created 2014-04-30
19
iam-veeramalla/shell-scripting-projects

Projects on shell scripting. Goal is to simulate real time projects as much as posible.

iam-veeramalla
โญ 1,155 Shell ๐Ÿ‘ค iam-veeramalla User ๐Ÿ• Updated 2024-08-17 ๐Ÿ“… Created 2023-04-14
20
elastic/ecs

Elastic Common Schema

elastic
โญ 1,125 Python ๐Ÿ‘ค elastic Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2018-05-24
21
julianpoy/RecipeSage

A Collaborative Recipe Keeper, Meal Planner, and Shopping List Organizer in PWA form.

julianpoy
โญ 1,009 TypeScript ๐Ÿ‘ค julianpoy User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2019-01-07
โญ 990 TypeScript ๐Ÿ‘ค run-llama Organization ๐Ÿ• Updated 2025-12-16 ๐Ÿ“… Created 2023-10-03
23
uniVocity/univocity-parsers

uniVocity-parsers is a suite of extremely fast and reliable parsers for Java. It provides a consistent interface for handling different file formats, and a solid framework for the development of new parsers.

uniVocity
โญ 931 Java ๐Ÿ‘ค uniVocity Organization ๐Ÿ• Updated 2024-08-17 ๐Ÿ“… Created 2014-07-12
โญ 895 Ruby ๐Ÿ‘ค uken Organization ๐Ÿ• Updated 2026-09-16 ๐Ÿ“… Created 2013-02-12
25
sdan/vlite

fastest vector database made in numpy

sdan
โญ 763 Python ๐Ÿ‘ค sdan User ๐Ÿ• Updated 2026-09-22 ๐Ÿ“… Created 2023-06-26
26
CrunchyData/pg_parquet

Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

CrunchyData
โญ 696 Rust ๐Ÿ‘ค CrunchyData Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-09-04
27
awslabs/aws-lambda-redshift-loader

Amazon Redshift Database Loader implemented in AWS Lambda

awslabs
โญ 596 JavaScript ๐Ÿ‘ค awslabs Organization ๐Ÿ• Updated 2024-07-16 ๐Ÿ“… Created 2015-03-05
28
coddingtonbear/inthe.am

Access your Taskwarrior tasks from any browser anywhere

coddingtonbear
โญ 593 Python ๐Ÿ‘ค coddingtonbear User ๐Ÿ• Updated 2024-01-03 ๐Ÿ“… Created 2013-12-30
29
ankushshah89/python-docx2txt

A pure python based utility to extract text and images from docx files.

ankushshah89
โญ 584 Python ๐Ÿ‘ค ankushshah89 User ๐Ÿ• Updated 2025-03-24 ๐Ÿ“… Created 2015-10-28
30
Datomic/codeq

Creates Datomic dbs from git repos

Datomic
โญ 556 Clojure ๐Ÿ‘ค Datomic Organization ๐Ÿ• Updated 2026-06-18 ๐Ÿ“… Created 2012-09-28
31
kevinlawler/kerf1

Kerf (Kerf1) is a columnar tick database and time-series language for Linux/OSX/BSD/iOS/Android. It is written in C and natively speaks JSON and SQL. Kerf can be used for trading platforms, feedhandlers, low-latency networking, high-volume analysis of realtime and historical data, logfile processing, and more.

kevinlawler
โญ 548 C ๐Ÿ‘ค kevinlawler User ๐Ÿ• Updated 2024-09-03 ๐Ÿ“… Created 2015-04-08
32
unbody-io/unbody

The Supabase of AI era. A modular, open-source backend for building AI-native software โ€” designed for knowledge, not static data.

unbody-io
โญ 525 TypeScript ๐Ÿ‘ค unbody-io Organization ๐Ÿ• Updated 2026-04-14 ๐Ÿ“… Created 2025-04-02
33
joshstevens19/reth-indexer

reth-indexer reads directly from the reth db and indexes the data into traditional and alternative databases / datastores (postgres, GCP bigquery, etc) all decoded with a simple config file and no extra setup alongside exposing a API ready to query the data.

joshstevens19
โญ 506 Rust ๐Ÿ‘ค joshstevens19 User ๐Ÿ• Updated 2024-01-11 ๐Ÿ“… Created 2023-07-04

Frequently Asked Questions

1

What is the most popular #data-ingestion repository on GitHub?

The top ranked open source #data-ingestion project on GitHub is apache/seatunnel with 9,821 stars. SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

2

Which programming languages are most used in #data-ingestion repositories?

Among the top ranked #data-ingestion projects on GitHub, the most common programming languages are Python, Java, Go, TypeScript.

3

How is the #data-ingestion repository ranking calculated?

We track 33 active open source repositories tagged with #data-ingestion (500+ stars), totaling 66,183 stars with an average of 2,005 stars per repository. Rankings update daily from the GitHub API.