#kafka Repositories
Discover 197 active open source GitHub repositories tagged with #kafka, accumulating 718,032 total stars (averaging 3,644 stars per project). Leading this topic is pathwaycom/pathway with 61,976 stars.
197 repositories total
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here ๐๐ผ
A repository covering six columns: Spring Boot 2.X, Spring Cloud, Spring Cloud Alibaba, Dubbo, distributed message queue, distributed transactions. Hope the chubby friends' little hands tremble, a Star in the upper right corner, thanks 1024.
Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.
Flink learning blog. http://www.54tianzhisheng.cn/ Contains content on Flink introduction, concepts, principles, practical implementation, performance tuning, source code analysis, etc. Involves learning cases on Flink Connector, Metrics, Library, DataStream API, Table API & SQL, etc., and sharing of large project cases for Flink production applications (PVUV, log storage, real-time deduplication of billions of data, monitoring alerts). Welcome everyone to support my column "Big Data Real-time Computing Engine Flink Practical and Performance Optimization".
ใBig Tech Interview Columnใ A technical guide for Java programmers, featuring interview questions, system architecture, career tips, mainstream middleware, and more, to help you become a better version of yourself!
Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
Diskless Kafkaยฎ on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
1200+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
A one-stop cloud-native real-time streaming data platform that builds enterprise-grade Kafka services through 0-intrusion and plug-ins, greatly lowering the bar for operating, storing, and managing real-time streaming data.
Distributed transaction solution in micro-service base on eventually consistency, also an eventbus with Outbox pattern
Usage-based pricing and billing for developers ๐ Cloud or self-hosted โ๏ธ No-code UI ๐ฐ Realtime usage metering ๐ Credits & top-ups ๐ Control feature access
Apache Camel is an open source integration framework with 350+ connectors. Write routes in Java, YAML, or XML. Run on Spring Boot, Quarkus, or standalone. Apache License 2.0.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL.
Apache Pinot: a real-time analytics database for low-latency SQL and vector search, serving user-facing and agent-facing applications
Message push platform๐ฅ pushes message types such as [Email][SMS][WeChat Official Account][WeChat Mini Program][Enterprise WeChat][DingTalk].
๐ Asynchronous thread pool framework, support Thread Pool Dynamic Change & monitoring & Alarm, no need to modify the code easily introduced.
๐ Personal technical sharing I've done... (topic: High-performance architecture, middleware principles and practices, cloud-native, Golang, etc.)
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.
๐ฅDevelop best practice projects based on the full technology stack of go zero (go zero) microservices. Develop best practice projects based on the full technology stack of go zero (go zero) microservices.
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
High-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time graph analytics. Cypher-compatible, built in C++.
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications โ at massive scale.
Learn Agentic AI using Dapr Agentic Cloud Ascent (DACA) Design Pattern and Agent-Native Cloud Technologies: OpenAI Agents SDK, Memory, MCP, A2A, Knowledge Graphs, Dapr, Rancher Desktop, and Kubernetes.
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.
Frequently Asked Questions
What is the most popular #kafka repository on GitHub?
The top ranked open source #kafka project on GitHub is pathwaycom/pathway with 61,976 stars. Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Which programming languages are most used in #kafka repositories?
Among the top ranked #kafka projects on GitHub, the most common programming languages are Java, Go, Python, Rust.
How is the #kafka repository ranking calculated?
We track 197 active open source repositories tagged with #kafka (500+ stars), totaling 718,032 stars with an average of 3,644 stars per repository. Rankings update daily from the GitHub API.