Git Stars Git Stars

#stream-processing Repositories

97
Total Repositories
414,395
Total Stars
4,272
Avg Stars/Repo
51
halaxa/json-machine

Efficient, easy-to-use, and fast PHP JSON stream parser

halaxa
โญ 1,334 PHP ๐Ÿ‘ค halaxa User ๐Ÿ• Updated 2026-10-25 ๐Ÿ“… Created 2018-11-05
52
gulpjs/vinyl

Virtual file format.

gulpjs
โญ 1,296 JavaScript ๐Ÿ‘ค gulpjs Organization ๐Ÿ• Updated 2026-11-03 ๐Ÿ“… Created 2013-12-20
53
kkyon/botflow

Python fast dataflow programming framework for data pipeline work (Web Crawler, Machine Learning, Quantitative Trading, etc.)

kkyon
โญ 1,195 Python ๐Ÿ‘ค kkyon User ๐Ÿ• Updated 2026-02-03 ๐Ÿ“… Created 2018-08-20
54
rxRust/rxRust

Zero-cost & Type-safe Reactive Extensions for Rust. Supports both high-performance single-threaded (Local) and thread-safe (Shared) contexts. WASM & Tokio ready.

rxRust
โญ 1,133 Rust ๐Ÿ‘ค rxRust Organization ๐Ÿ• Updated 2026-10-11 ๐Ÿ“… Created 2019-05-19
55
spring-cloud/spring-cloud-stream

Framework for building Event-Driven Microservices

spring-cloud
โญ 1,071 Java ๐Ÿ‘ค spring-cloud Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2015-07-08
56
clj-commons/manifold

A compatibility layer for event-driven abstractions

clj-commons
โญ 1,057 Clojure ๐Ÿ‘ค clj-commons Organization ๐Ÿ• Updated 2026-03-16 ๐Ÿ“… Created 2014-03-04
57
apache/flink-training

Apache Flink Training Excercises

apache
โญ 1,048 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-05-15 ๐Ÿ“… Created 2020-04-20
58
harlan-zw/mdream

โ˜๏ธ The fastest HTML to markdown convertor on GitHub. Optimized for LLMs and supports streaming.

harlan-zw
โญ 1,032 TypeScript ๐Ÿ‘ค harlan-zw User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-04-16
59
OWASP/java-html-sanitizer

Takes third-party HTML and produces HTML that is safe to embed in your web application. Fast and easy to configure.

OWASP
โญ 957 Java ๐Ÿ‘ค OWASP Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2015-04-27
60
sindresorhus/hasha

Hashing made simple. Get the hash of a buffer/string/stream/file.

sindresorhus
โญ 953 JavaScript ๐Ÿ‘ค sindresorhus User ๐Ÿ• Updated 2026-07-21 ๐Ÿ“… Created 2015-05-23
61
vxgmichel/aiostream

Generator-based operators for asynchronous iteration

vxgmichel
โญ 921 Python ๐Ÿ‘ค vxgmichel User ๐Ÿ• Updated 2026-11-15 ๐Ÿ“… Created 2016-08-04
62
mafintosh/pump

pipe streams together and close all of them if one of them closes

mafintosh
โญ 917 JavaScript ๐Ÿ‘ค mafintosh User ๐Ÿ• Updated 2026-02-28 ๐Ÿ“… Created 2013-08-14
63
ververica/flink-sql-cookbook

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

ververica
โญ 915 Dockerfile ๐Ÿ‘ค ververica Organization ๐Ÿ• Updated 2026-01-12 ๐Ÿ“… Created 2020-12-01
64
vladimirvivien/automi

A stream processing API for Go (now with generic type support)

vladimirvivien
โญ 848 Go ๐Ÿ‘ค vladimirvivien User ๐Ÿ• Updated 2025-06-01 ๐Ÿ“… Created 2015-09-13
65
thejoshwolfe/yauzl

yet another unzip library for node

thejoshwolfe
โญ 832 JavaScript ๐Ÿ‘ค thejoshwolfe User ๐Ÿ• Updated 2026-06-07 ๐Ÿ“… Created 2014-08-19
66
diesel-rs/diesel_async

Diesel async connection implementation

diesel-rs
โญ 829 Rust ๐Ÿ‘ค diesel-rs Organization ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2021-12-23
67
rxaviers/async-pool

Run multiple promise-returning & async functions with limited concurrency using native ES6/ES7

rxaviers
โญ 822 JavaScript ๐Ÿ‘ค rxaviers User ๐Ÿ• Updated 2025-07-29 ๐Ÿ“… Created 2018-05-21
68
MiloszKrajewski/K4os.Compression.LZ4

LZ4/LH4HC compression for .NET Standard 1.6/2.0 (formerly known as lz4net)

MiloszKrajewski
โญ 817 C# ๐Ÿ‘ค MiloszKrajewski User ๐Ÿ• Updated 2026-03-28 ๐Ÿ“… Created 2018-01-28
69
mhart/kinesalite

An implementation of Amazon's Kinesis built on LevelDB

mhart
โญ 810 JavaScript ๐Ÿ‘ค mhart User ๐Ÿ• Updated 2024-04-23 ๐Ÿ“… Created 2013-11-14
70
turbolytics/sql-flow

DuckDB for streaming data

turbolytics
โญ 808 Go ๐Ÿ‘ค turbolytics User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2023-11-21
71
gazette/core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

gazette
โญ 798 Go ๐Ÿ‘ค gazette Organization ๐Ÿ• Updated 2026-11-14 ๐Ÿ“… Created 2017-10-20
72
pipeless-ai/pipeless

An open-source computer vision framework to build and deploy apps in minutes

pipeless-ai
โญ 794 Rust ๐Ÿ‘ค pipeless-ai Organization ๐Ÿ• Updated 2024-05-08 ๐Ÿ“… Created 2023-07-21
73
apache/streampipes

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

apache
โญ 763 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-11-20 ๐Ÿ“… Created 2018-04-22
75
gearpump/gearpump

Lightweight real-time big data streaming engine over Apache Pekko

gearpump
โญ 757 Scala ๐Ÿ‘ค gearpump Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2014-07-23
76
composefs/tar-rs

Tar file reading/writing for Rust

composefs
โญ 748 Rust ๐Ÿ‘ค composefs Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2014-07-17
77
TouK/nussknacker

Low-code tool for automating actions on real time data | Stream processing for the users.

TouK
โญ 746 Scala ๐Ÿ‘ค TouK Organization ๐Ÿ• Updated 2026-09-30 ๐Ÿ“… Created 2017-06-29
78
CZ-NIC/pz

Easily handle day to day CLI operation via Python instead of regular Bash programs. ๐Ÿ‡บ๐Ÿ‡ฆ #supporting

CZ-NIC
โญ 732 Python ๐Ÿ‘ค CZ-NIC Organization ๐Ÿ• Updated 2025-11-24 ๐Ÿ“… Created 2020-11-25
79
hstreamdb/hstream

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

hstreamdb
โญ 728 Haskell ๐Ÿ‘ค hstreamdb Organization ๐Ÿ• Updated 2024-12-26 ๐Ÿ“… Created 2020-08-31
80
pngjs/pngjs

Simple PNG encoder/decoder

pngjs
โญ 721 JavaScript ๐Ÿ‘ค pngjs Organization ๐Ÿ• Updated 2024-03-23 ๐Ÿ“… Created 2015-07-30
81
buildkite/terminal-to-html

Converts arbitrary shell output (with ANSI) into beautifully rendered HTML

buildkite
โญ 721 Go ๐Ÿ‘ค buildkite Organization ๐Ÿ• Updated 2026-11-09 ๐Ÿ“… Created 2014-07-08
82
hparra/gulp-rename

Rename files easily

hparra
โญ 685 JavaScript ๐Ÿ‘ค hparra User ๐Ÿ• Updated 2025-07-16 ๐Ÿ“… Created 2013-12-04
83
vstinner/hachoir

Hachoir is a Python library to view and edit a binary stream field by field

vstinner
โญ 671 Python ๐Ÿ‘ค vstinner User ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2016-10-01
84
sindresorhus/image-dimensions

Get the dimensions of an image

sindresorhus
โญ 611 JavaScript ๐Ÿ‘ค sindresorhus User ๐Ÿ• Updated 2026-09-18 ๐Ÿ“… Created 2023-11-05
85
dpnkrpl/radio-active

Play any radios around the globe right from the terminal :zap:

dpnkrpl
โญ 610 Python ๐Ÿ‘ค dpnkrpl User ๐Ÿ• Updated 2026-11-11 ๐Ÿ“… Created 2021-04-27
โญ 605 Go ๐Ÿ‘ค cashapp Organization ๐Ÿ• Updated 2025-03-31 ๐Ÿ“… Created 2021-05-30
87
p2panda/p2panda

All the things a panda needs

p2panda
โญ 602 Rust ๐Ÿ‘ค p2panda Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2020-10-12
88
infoslack/awesome-kafka

A list about Apache Kafka

infoslack
โญ 595 ๐Ÿ‘ค infoslack User ๐Ÿ• Updated 2026-05-05 ๐Ÿ“… Created 2016-04-29
89
cgrand/xforms

Extra transducers and reducing fns for Clojure(script)

cgrand
โญ 591 Clojure ๐Ÿ‘ค cgrand User ๐Ÿ• Updated 2024-01-22 ๐Ÿ“… Created 2015-09-03
90
mikaelbr/gulp-notify

gulp plugin to send messages based on Vinyl Files or Errors to Mac OS X, Linux or Windows using the node-notifier module. Fallbacks to Growl or simply logging

mikaelbr
โญ 589 JavaScript ๐Ÿ‘ค mikaelbr User ๐Ÿ• Updated 2026-01-21 ๐Ÿ“… Created 2014-01-08
91
microsoft/psi

Platform for Situated Intelligence

microsoft
โญ 577 C# ๐Ÿ‘ค microsoft Organization ๐Ÿ• Updated 2026-10-19 ๐Ÿ“… Created 2016-09-09
92
hazelcast/hazelcast-code-samples

Hazelcast Code Samples

hazelcast
โญ 558 Java ๐Ÿ‘ค hazelcast Organization ๐Ÿ• Updated 2026-11-02 ๐Ÿ“… Created 2013-07-27
93
apache/flink-playgrounds

Apache Flink Playgrounds

apache
โญ 555 Java ๐Ÿ‘ค apache Organization ๐Ÿ• Updated 2026-09-28 ๐Ÿ“… Created 2019-07-12
94
leesf/hudi-resources

Summary of Apache Hudi related materials

leesf
โญ 554 ๐Ÿ‘ค leesf User ๐Ÿ• Updated 2026-03-31 ๐Ÿ“… Created 2019-12-11
95
sabre-io/xml

sabre/xml is an XML library that you may not hate.

sabre-io
โญ 529 PHP ๐Ÿ‘ค sabre-io Organization ๐Ÿ• Updated 2026-11-01 ๐Ÿ“… Created 2012-11-13
96
gdsestimating/dxf-parser

A javascript parser for DXF files. It reads DXF file strings into one large javascript object with more readable properties and a more logical structure.

gdsestimating
โญ 527 TypeScript ๐Ÿ‘ค gdsestimating Organization ๐Ÿ• Updated 2024-06-20 ๐Ÿ“… Created 2015-04-23
97
alecthomas/pawk

PAWK - A Python line processor (like AWK)

alecthomas
โญ 524 Python ๐Ÿ‘ค alecthomas User ๐Ÿ• Updated 2024-02-12 ๐Ÿ“… Created 2013-02-09