#stream-processing Repositories
Discover 97 active open source GitHub repositories tagged with #stream-processing, accumulating 414,395 total stars (averaging 4,272 stars per project). Leading this topic is pathwaycom/pathway with 61,976 stars.
97 repositories total
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Flink learning blog. http://www.54tianzhisheng.cn/ Contains content on Flink introduction, concepts, principles, practical implementation, performance tuning, source code analysis, etc. Involves learning cases on Flink Connector, Metrics, Library, DataStream API, Table API & SQL, etc., and sharing of large project cases for Flink production applications (PVUV, log storage, real-time deduplication of billions of data, monitoring alerts). Welcome everyone to support my column "Big Data Real-time Computing Engine Flink Practical and Performance Optimization".
A curated list of awesome big data frameworks, ressources and other awesomeness.
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL.
Message push platform๐ฅ pushes message types such as [Email][SMS][WeChat Official Account][WeChat Mini Program][Enterprise WeChat][DingTalk].
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
๐ฆ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
Incomplete Redis client and server implementation using Tokio - for learning purposes only
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
The fastest unified streaming SQL engine in a single C++ binary. โก Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
jOOฮป - The Missing Parts in Java 8 jOOฮป improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.
The minimalistic but powerful, modular, functional reactive programming library in JavaScript.
Frequently Asked Questions
What is the most popular #stream-processing repository on GitHub?
The top ranked open source #stream-processing project on GitHub is pathwaycom/pathway with 61,976 stars. Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Which programming languages are most used in #stream-processing repositories?
Among the top ranked #stream-processing projects on GitHub, the most common programming languages are Rust, Python, Java, JavaScript.
How is the #stream-processing repository ranking calculated?
We track 97 active open source repositories tagged with #stream-processing (500+ stars), totaling 414,395 stars with an average of 4,272 stars per repository. Rankings update daily from the GitHub API.