Git Stars Git Stars

#data-pipeline Repositories

67
Total Repositories
219,024
Total Stars
3,269
Avg Stars/Repo
51
transferwise/pipelinewise

Data Pipeline Framework using the singer.io spec

transferwise
โญ 663 Python ๐Ÿ‘ค transferwise Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-09-04
52
leedrake5/Russia-Ukraine

Equipment Loss Tracking

leedrake5
โญ 659 R ๐Ÿ‘ค leedrake5 User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-03-07
53
tsaikd/gogstash

Logstash like, written in golang

tsaikd
โญ 643 Go ๐Ÿ‘ค tsaikd User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-12-10
54
lzjqsdd/NewsSpider

Crawl news from Toutiao, NetEase, Tencent, etc., and build a simple search engine

lzjqsdd
โญ 638 Python ๐Ÿ‘ค lzjqsdd User ๐Ÿ• Updated 2024-05-14 ๐Ÿ“… Created 2016-04-19
55
ConduitIO/conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

ConduitIO
โญ 617 Go ๐Ÿ‘ค ConduitIO Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-01-11
56
infoslack/awesome-kafka

A list about Apache Kafka

infoslack
โญ 595 ๐Ÿ‘ค infoslack User ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2016-04-29
57
oscarbaruffa/BigBookofR

The biggest collection of R books (and maybe later some other resources too)

oscarbaruffa
โญ 591 HTML ๐Ÿ‘ค oscarbaruffa User ๐Ÿ• Updated 2026-04-26 ๐Ÿ“… Created 2020-08-25
58
Blosc/c-blosc2

A fast, compressed, persistent binary data store library for C.

Blosc
โญ 591 C ๐Ÿ‘ค Blosc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-08-07
59
huggingface/text-clustering

Easily embed, cluster and semantically label text datasets

huggingface
โญ 586 Python ๐Ÿ‘ค huggingface Organization ๐Ÿ• Updated 2024-03-28 ๐Ÿ“… Created 2024-01-12
60
adept/full-fledged-hledger

Tutorial on Hledger setup with multi-year files, multi-source imports and a range of auto-generated reports

adept
โญ 582 Haskell ๐Ÿ‘ค adept User ๐Ÿ• Updated 2026-10-22 ๐Ÿ“… Created 2017-12-01
61
mrthinger/wow-voiceover

ml world of warcraft voiceover addon

mrthinger
โญ 580 Lua ๐Ÿ‘ค mrthinger User ๐Ÿ• Updated 2026-07-29 ๐Ÿ“… Created 2023-03-18
62
pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

pracdata
โญ 564 ๐Ÿ‘ค pracdata Organization ๐Ÿ• Updated 2025-03-12 ๐Ÿ“… Created 2024-02-22
63
sparkfish/augraphy

Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes

sparkfish
โญ 559 Python ๐Ÿ‘ค sparkfish Organization ๐Ÿ• Updated 2025-07-20 ๐Ÿ“… Created 2021-05-31
64
backblaze-labs/genblaze

Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for every output.

backblaze-labs
โญ 548 Python ๐Ÿ‘ค backblaze-labs Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2026-04-16
65
kvakvs/beam-wisdoms

Wiki containing pieces of information and knowledge about BEAM Virtual machine (which runs Erlang/OTP and other BEAM-based languages).

kvakvs
โญ 539 ๐Ÿ‘ค kvakvs User ๐Ÿ• Updated 2024-06-10 ๐Ÿ“… Created 2016-08-27
โญ 508 Rust ๐Ÿ‘ค general-works Organization ๐Ÿ• Updated 2025-08-20 ๐Ÿ“… Created 2025-05-18
67
tmplink/IPDB

National IP database, providing data based on CIDR and NETMASK format, supporting IPv4 and IPv6.

tmplink
โญ 503 ๐Ÿ‘ค tmplink User ๐Ÿ• Updated 2026-03-10 ๐Ÿ“… Created 2020-10-23