Git Stars Git Stars

#stream-processing Repositories

Discover 97 active open source GitHub repositories tagged with #stream-processing, accumulating 414,395 total stars (averaging 4,272 stars per project). Leading this topic is pathwaycom/pathway with 61,976 stars.

97
Total Repositories
414,395
Total Stars
4,272
Avg Stars/Repo
1
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

pathwaycom
โญ 61,976 Python ๐Ÿ‘ค pathwaycom Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-11-27
2
google-ai-edge/mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

google-ai-edge
โญ 37,769 C++ ๐Ÿ‘ค google-ai-edge Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-06-13
3
vectordotdev/vector

A high-performance observability data pipeline.

vectordotdev
โญ 22,928 Rust ๐Ÿ‘ค vectordotdev Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2018-08-27
4
questdb/questdb

QuestDB is a high performance, open-source, time-series database

questdb
โญ 17,543 Java ๐Ÿ‘ค questdb Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2014-04-28
5
zhisheng17/flink-learning

Flink learning blog. http://www.54tianzhisheng.cn/ Contains content on Flink introduction, concepts, principles, practical implementation, performance tuning, source code analysis, etc. Involves learning cases on Flink Connector, Metrics, Library, DataStream API, Table API & SQL, etc., and sharing of large project cases for Flink production applications (PVUV, log storage, real-time deduplication of billions of data, monitoring alerts). Welcome everyone to support my column "Big Data Real-time Computing Engine Flink Practical and Performance Optimization".

zhisheng17
โญ 15,109 Java ๐Ÿ‘ค zhisheng17 User ๐Ÿ• Updated 2026-05-06 ๐Ÿ“… Created 2019-01-01
6
oxnr/awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr
โญ 14,744 ๐Ÿ‘ค oxnr User ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2014-07-04
7
redpanda-data/redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

redpanda-data
โญ 12,681 C++ ๐Ÿ‘ค redpanda-data Organization ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2020-11-02
8
madd86/awesome-system-design

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

madd86
โญ 12,666 ๐Ÿ‘ค madd86 User ๐Ÿ• Updated 2026-02-27 ๐Ÿ“… Created 2020-07-10
9
expressjs/multer

Node.js middleware for handling `multipart/form-data`.

expressjs
โญ 12,088 JavaScript ๐Ÿ‘ค expressjs Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2014-01-30
10
ThreeDotsLabs/watermill

Building event-driven applications the easy way in Go.

ThreeDotsLabs
โญ 9,973 Go ๐Ÿ‘ค ThreeDotsLabs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-11-08
11
risingwavelabs/risingwave

Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.

risingwavelabs
โญ 9,425 Rust ๐Ÿ‘ค risingwavelabs Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-01-28
12
redpanda-data/connect

Fancy stream processing made operationally mundane

redpanda-data
โญ 8,804 Go ๐Ÿ‘ค redpanda-data Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-03-22
13
fluent/fluent-bit

Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows

fluent
โญ 8,203 C ๐Ÿ‘ค fluent Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2015-01-27
14
robinhood/faust

Python Stream Processing

robinhood
โญ 6,830 Python ๐Ÿ‘ค robinhood Organization ๐Ÿ• Updated 2024-07-27 ๐Ÿ“… Created 2017-03-08
15
hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

hazelcast
โญ 6,636 Java ๐Ÿ‘ค hazelcast Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2012-03-21
16
MaterializeInc/materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL.

MaterializeInc
โญ 6,407 Rust ๐Ÿ‘ค MaterializeInc Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2019-02-22
17
apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

apache
โญ 6,387 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2016-12-14
18
online-ml/river

๐ŸŒŠ Online machine learning in Python

online-ml
โญ 6,151 Python ๐Ÿ‘ค online-ml Organization ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2019-01-24
19
ZhongFuCheng3y/austin

Message push platform๐Ÿ”ฅ pushes message types such as [Email][SMS][WeChat Official Account][WeChat Mini Program][Enterprise WeChat][DingTalk].

ZhongFuCheng3y
โญ 6,113 Java ๐Ÿ‘ค ZhongFuCheng3y User ๐Ÿ• Updated 2026-06-10 ๐Ÿ“… Created 2021-11-06
20
matthewmueller/x-ray

The next web scraper. See through the <html> noise.

matthewmueller
โญ 5,899 JavaScript ๐Ÿ‘ค matthewmueller User ๐Ÿ• Updated 2026-08-31 ๐Ÿ“… Created 2015-02-05
21
tape-testing/tape

tap-producing test harness for node and browsers

tape-testing
โญ 5,799 JavaScript ๐Ÿ‘ค tape-testing Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2012-11-25
22
edenhill/kcat

Generic command line non-JVM Apache Kafka producer and consumer

edenhill
โญ 5,702 C ๐Ÿ‘ค edenhill User ๐Ÿ• Updated 2024-07-09 ๐Ÿ“… Created 2014-03-30
23
ag2ai/faststream

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

ag2ai
โญ 5,396 Python ๐Ÿ‘ค ag2ai Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-12-01
24
fluvio-community/fluvio

๐Ÿฆ€ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

fluvio-community
โญ 5,270 Rust ๐Ÿ‘ค fluvio-community Organization ๐Ÿ• Updated 2026-11-05 ๐Ÿ“… Created 2019-08-31
25
ArroyoSystems/arroyo

Distributed stream processing engine in Rust

ArroyoSystems
โญ 5,083 Rust ๐Ÿ‘ค ArroyoSystems Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-03-31
26
javascriptdata/danfojs

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

javascriptdata
โญ 5,067 TypeScript ๐Ÿ‘ค javascriptdata Organization ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2020-05-13
27
reactive-streams/reactive-streams-jvm

Reactive Streams Specification for the JVM

reactive-streams
โญ 4,864 Java ๐Ÿ‘ค reactive-streams Organization ๐Ÿ• Updated 2024-03-13 ๐Ÿ“… Created 2014-02-28
28
tokio-rs/mini-redis

Incomplete Redis client and server implementation using Tokio - for learning purposes only

tokio-rs
โญ 4,813 Rust ๐Ÿ‘ค tokio-rs Organization ๐Ÿ• Updated 2026-04-15 ๐Ÿ“… Created 2019-12-04
29
TimelyDataflow/timely-dataflow

A modular implementation of timely dataflow in Rust

TimelyDataflow
โญ 3,664 Rust ๐Ÿ‘ค TimelyDataflow Organization ๐Ÿ• Updated 2026-11-08 ๐Ÿ“… Created 2014-12-07
30
PeerDB-io/peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

PeerDB-io
โญ 3,322 Go ๐Ÿ‘ค PeerDB-io Organization ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-04-15
31
manuzhang/awesome-streaming

a curated list of awesome streaming frameworks, applications, etc

manuzhang
โญ 3,037 JavaScript ๐Ÿ‘ค manuzhang User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2014-12-18
32
numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

numaproj
โญ 2,837 Rust ๐Ÿ‘ค numaproj Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2022-05-20
33
hashicorp/yamux

Golang connection multiplexing library

hashicorp
โญ 2,712 Go ๐Ÿ‘ค hashicorp Organization ๐Ÿ• Updated 2026-10-12 ๐Ÿ“… Created 2014-05-22
34
birdayz/kaf

Modern CLI for Apache Kafka, written in Go.

birdayz
โญ 2,447 Go ๐Ÿ‘ค birdayz User ๐Ÿ• Updated 2026-05-07 ๐Ÿ“… Created 2018-09-11
35
timeplus-io/proton

The fastest unified streaming SQL engine in a single C++ binary. โšก Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

timeplus-io
โญ 2,286 C++ ๐Ÿ‘ค timeplus-io Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2023-08-14
36
reugn/go-streams

A lightweight stream processing library for Go

reugn
โญ 2,178 Go ๐Ÿ‘ค reugn User ๐Ÿ• Updated 2026-01-14 ๐Ÿ“… Created 2019-04-30
37
frankmcsherry/blog

Some notes on things I find interesting and important.

frankmcsherry
โญ 2,122 JavaScript ๐Ÿ‘ค frankmcsherry User ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-08-07
38
jOOQ/jOOL

jOOฮป - The Missing Parts in Java 8 jOOฮป improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.

jOOQ
โญ 2,120 Java ๐Ÿ‘ค jOOQ Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2014-03-02
39
bytewax/bytewax

Python Stream Processing

bytewax
โญ 2,074 Python ๐Ÿ‘ค bytewax Organization ๐Ÿ• Updated 2026-11-13 ๐Ÿ“… Created 2022-02-04
40
kimjammer/Neuro

A recreation of Neuro-Sama originally created in 7 days.

kimjammer
โญ 1,960 Python ๐Ÿ‘ค kimjammer User ๐Ÿ• Updated 2025-01-17 ๐Ÿ“… Created 2024-01-07
41
nubskr/walrus

๐Ÿฆญ Distributed log streaming engine built from first principles

nubskr
โญ 1,943 Rust ๐Ÿ‘ค nubskr User ๐Ÿ• Updated 2026-10-20 ๐Ÿ“… Created 2025-09-17
42
pinojs/pino-pretty

๐ŸŒฒBasic prettifier for Pino log lines

pinojs
โญ 1,711 JavaScript ๐Ÿ‘ค pinojs Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-03-30
43
clue/stream-filter

A simple and modern approach to stream filtering in PHP

clue
โญ 1,698 PHP ๐Ÿ‘ค clue User ๐Ÿ• Updated 2026-11-17 ๐Ÿ“… Created 2015-10-17
44
nerevu/riko

A Python stream processing engine modeled after Yahoo! Pipes

nerevu
โญ 1,605 Python ๐Ÿ‘ค nerevu Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2016-06-02
45
siddhi-io/siddhi

Stream Processing and Complex Event Processing Engine

siddhi-io
โญ 1,595 Java ๐Ÿ‘ค siddhi-io Organization ๐Ÿ• Updated 2026-10-08 ๐Ÿ“… Created 2014-04-21
46
quixio/quix-streams

Python Streaming DataFrames for Kafka

quixio
โญ 1,582 Python ๐Ÿ‘ค quixio Organization ๐Ÿ• Updated 2026-11-18 ๐Ÿ“… Created 2022-11-17
47
paldepind/flyd

The minimalistic but powerful, modular, functional reactive programming library in JavaScript.

paldepind
โญ 1,566 JavaScript ๐Ÿ‘ค paldepind User ๐Ÿ• Updated 2024-02-05 ๐Ÿ“… Created 2015-02-25
48
annamedv/red

Red Analytics Tool

annamedv
โญ 1,490 Go ๐Ÿ‘ค annamedv User ๐Ÿ• Updated 2026-05-12 ๐Ÿ“… Created 2019-03-19
49
WallarooLabs/wally

Distributed Stream Processing

WallarooLabs
โญ 1,484 Pony ๐Ÿ‘ค WallarooLabs Organization ๐Ÿ• Updated 2026-09-03 ๐Ÿ“… Created 2015-12-30
50
ReactiveX/IxJS

The Interactive Extensions for JavaScript

ReactiveX
โญ 1,410 TypeScript ๐Ÿ‘ค ReactiveX Organization ๐Ÿ• Updated 2025-05-13 ๐Ÿ“… Created 2016-02-22

Frequently Asked Questions

1

What is the most popular #stream-processing repository on GitHub?

The top ranked open source #stream-processing project on GitHub is pathwaycom/pathway with 61,976 stars. Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

2

Which programming languages are most used in #stream-processing repositories?

Among the top ranked #stream-processing projects on GitHub, the most common programming languages are Rust, Python, Java, JavaScript.

3

How is the #stream-processing repository ranking calculated?

We track 97 active open source repositories tagged with #stream-processing (500+ stars), totaling 414,395 stars with an average of 4,272 stars per repository. Rankings update daily from the GitHub API.