Git Stars Git Stars

#streaming-data Repositories

Discover 33 active open source GitHub repositories tagged with #streaming-data, accumulating 132,146 total stars (averaging 4,004 stars per project). Leading this topic is meta/zstd with 28,281 stars.

33
Total Repositories
132,146
Total Stars
4,004
Avg Stars/Repo
1
meta/zstd

Zstandard - Fast real-time compression algorithm

meta
โญ 28,281 C ๐Ÿ‘ค meta Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-01-24
2
oxnr/awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr
โญ 14,744 ๐Ÿ‘ค oxnr User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2014-07-04
3
provectus/kafka-ui

Open-Source Web UI for Apache Kafka Management

provectus
โญ 11,754 Java ๐Ÿ‘ค provectus Organization ๐Ÿ• Updated 2024-07-26 ๐Ÿ“… Created 2019-11-26
4
johnkerl/miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

johnkerl
โญ 10,069 Go ๐Ÿ‘ค johnkerl User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-05-03
5
redpanda-data/connect

Fancy stream processing made operationally mundane

redpanda-data
โญ 8,804 Go ๐Ÿ‘ค redpanda-data Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-03-22
6
MaterializeInc/materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL.

MaterializeInc
โญ 6,407 Rust ๐Ÿ‘ค MaterializeInc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-02-22
7
online-ml/river

๐ŸŒŠ Online machine learning in Python

online-ml
โญ 6,151 Python ๐Ÿ‘ค online-ml Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2019-01-24
8
readysettech/readyset

ReadySet is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.

readysettech
โญ 5,303 Rust ๐Ÿ‘ค readysettech Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2022-05-24
9
fluvio-community/fluvio

๐Ÿฆ€ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

fluvio-community
โญ 5,270 Rust ๐Ÿ‘ค fluvio-community Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2019-08-31
10
jimhigson/oboe.js

A streaming approach to JSON. Oboe.js speeds up web applications by providing parsed objects before the response completes.

jimhigson
โญ 4,815 JavaScript ๐Ÿ‘ค jimhigson User ๐Ÿ• Updated 2025-11-17 ๐Ÿ“… Created 2013-03-11
11
piskvorky/smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

piskvorky
โญ 3,468 Python ๐Ÿ‘ค piskvorky User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-01-02
12
kafbat/kafka-ui

Open-Source Web UI for managing Apache Kafka clusters

kafbat
โญ 2,852 TypeScript ๐Ÿ‘ค kafbat Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2024-01-22
13
reugn/go-streams

A lightweight stream processing library for Go

reugn
โญ 2,178 Go ๐Ÿ‘ค reugn User ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2019-04-30
14
bytewax/bytewax

Python Stream Processing

bytewax
โญ 2,074 Python ๐Ÿ‘ค bytewax Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2022-02-04
15
numenta/NAB

The Numenta Anomaly Benchmark

numenta
โญ 2,062 Jupyter Notebook ๐Ÿ‘ค numenta Organization ๐Ÿ• Updated 2024-12-03 ๐Ÿ“… Created 2014-05-06
16
pravega/pravega

Pravega - Streaming as a new software defined storage primitive

pravega
โญ 2,003 Java ๐Ÿ‘ค pravega Organization ๐Ÿ• Updated 2025-03-02 ๐Ÿ“… Created 2016-07-11
17
quixio/quix-streams

Python Streaming DataFrames for Kafka

quixio
โญ 1,582 Python ๐Ÿ‘ค quixio Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2022-11-17
18
atomicobject/heatshrink

data compression library for embedded/real-time systems

atomicobject
โญ 1,499 C ๐Ÿ‘ค atomicobject Organization ๐Ÿ• Updated 2024-05-19 ๐Ÿ“… Created 2013-03-13
19
python-streamz/streamz

Real-time stream processing for python

python-streamz
โญ 1,304 Python ๐Ÿ‘ค python-streamz Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2017-04-04
20
meta-pytorch/data

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

meta-pytorch
โญ 1,266 Python ๐Ÿ‘ค meta-pytorch Organization ๐Ÿ• Updated 2026-11-12 ๐Ÿ“… Created 2021-05-12
21
microsoft/Trill

Trill is a single-node query processor for temporal or streaming data.

microsoft
โญ 1,254 C# ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2024-01-08 ๐Ÿ“… Created 2018-09-26
22
NationalSecurityAgency/lemongraph

Log-based transactional graph engine

NationalSecurityAgency
โญ 1,243 Python ๐Ÿ‘ค NationalSecurityAgency Organization ๐Ÿ• Updated 2026-04-30 ๐Ÿ“… Created 2016-07-25
23
zpl-c/zpl

๐Ÿ“ Pushing the boundaries of simplicity

zpl-c
โญ 1,065 C ๐Ÿ‘ค zpl-c Organization ๐Ÿ• Updated 2025-04-26 ๐Ÿ“… Created 2017-07-10
24
wzzheng/StreamVGGT

[ICLR 2026] Streaming 4D Visual Geometry Transformer

wzzheng
โญ 988 Python ๐Ÿ‘ค wzzheng User ๐Ÿ• Updated 2025-10-27 ๐Ÿ“… Created 2025-07-14
25
joshday/OnlineStats.jl

โšก Single-pass algorithms for statistics

joshday
โญ 900 Julia ๐Ÿ‘ค joshday User ๐Ÿ• Updated 2026-09-21 ๐Ÿ“… Created 2015-02-04
26
hstreamdb/hstream

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

hstreamdb
โญ 728 Haskell ๐Ÿ‘ค hstreamdb Organization ๐Ÿ• Updated 2024-12-26 ๐Ÿ“… Created 2020-08-31
27
showlab/videollm-online

VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

showlab
โญ 690 Python ๐Ÿ‘ค showlab Organization ๐Ÿ• Updated 2025-11-26 ๐Ÿ“… Created 2024-06-17
28
streamdal/streamdal

Code-Native Data Privacy

streamdal
โญ 613 TypeScript ๐Ÿ‘ค streamdal Organization ๐Ÿ• Updated 2024-11-15 ๐Ÿ“… Created 2023-08-04
โญ 605 Go ๐Ÿ‘ค cashapp Organization ๐Ÿ• Updated 2025-03-31 ๐Ÿ“… Created 2021-05-30
30
infoslack/awesome-kafka

A list about Apache Kafka

infoslack
โญ 595 ๐Ÿ‘ค infoslack User ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2016-04-29
31
guillermo-navas-palencia/optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

guillermo-navas-palencia
โญ 538 Python ๐Ÿ‘ค guillermo-navas-palencia User ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2019-12-31
32
Sinotrade/Shioaji

Shioaji all new cross platform api for trading

Sinotrade
โญ 534 Dockerfile ๐Ÿ‘ค Sinotrade Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2018-11-21
33
kLabUM/rrcf

๐ŸŒฒ Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams

kLabUM
โญ 519 Python ๐Ÿ‘ค kLabUM Organization ๐Ÿ• Updated 2024-02-24 ๐Ÿ“… Created 2018-10-20

Frequently Asked Questions

1

What is the most popular #streaming-data repository on GitHub?

The top ranked open source #streaming-data project on GitHub is meta/zstd with 28,281 stars. Zstandard - Fast real-time compression algorithm

2

Which programming languages are most used in #streaming-data repositories?

Among the top ranked #streaming-data projects on GitHub, the most common programming languages are Python, Go, C, Rust.

3

How is the #streaming-data repository ranking calculated?

We track 33 active open source repositories tagged with #streaming-data (500+ stars), totaling 132,146 stars with an average of 4,004 stars per repository. Rankings update daily from the GitHub API.