#kafka Repositories
197 repositories total
The ultimate distributed MQTT broker. Handles 100M+ connections and 10M msg/sec with ease. Built on Kafka to provide industrial-grade persistence and eliminate data loss.
Shortlink service (Microservice example) โญ๏ธ Star the repo if you like it!
๐ฆ Forum: Based on SpringBoot + MyBatis + MySQL + Redis + Kafka + Elasticsearch + Spring Security + ... and provides detailed development documentation and accompanying tutorials. Includes modules such as posts, comments, private messages, system notifications, likes, follows, search, user settings, data statistics, etc.
Low-code tool for automating actions on real time data | Stream processing for the users.
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Golang framework for streaming ETL, observability data pipeline, and event processing apps
KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
Mendmix Positioning is an all-in-one distributed development architecture open-source solution and a cloud-native architecture technology foundation. Mendmix provides databases, caching, message middleware, distributed timed tasks, security frameworks, gateways, and rapid integration capabilities with mainstream vendor cloud services. Based on Mendmix, high-concurrency, high-availability, microservice-based distributed architectures can be quickly built without worrying about technical details.
Modular e-commerce backend with a GraphQL gateway and gRPC microservices for accounts, products, orders, payments, and recommendations.
The data stream engine is a data-driven underlying engine for data integration, data synchronization, data exchange, data sharing, task configuration, and task scheduling. The data stream engine adopts architectures such as control-execution separation, multi-stream layers, and a plugin library to address the actual data problems of large-scale data tasks, high-frequency data reporting, high-frequency data acquisition, and heterogeneous data compatibility.
KCloud-Platform-IoT (Lao Kou IoT Cloud Platform) is an enterprise-grade IoT cloud platform that supports both monolithic and microservice architectures. It adopts the DDD (Domain-Driven Design) approach and is a cloud-based, multi-tenant IoT platform developed with the latest versions of Spring Boot 4.1.1, Spring Cloud 2025.1.3, and Spring Cloud Alibaba 2025.1.0.0. Everyone, please give it a star! Pretty please~
Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.
Lightweight message bus interface for .NET (pub/sub and request-response) with transport plugins for popular message brokers.
๐ฅ๐ฅ๐ฅ Visual drag-and-drop big data integration platform, big data platform, and big data solution, featuring data flow, data sources, data alignment, query templates, intelligent Q&A, AI integration, and comprehensive monitoring. Synchronize and clean data in a no-code, flowchart-like manner.
Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. Test Data Generation Tool
NetDiscovery is a general-purpose crawler framework/middleware implemented based on frameworks such as Vert.x and RxJava 2.
Proxy connections to Kafka cluster. Connect through SOCKS Proxy, HTTP Proxy or to cluster running in Kubernetes.
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Community-driven, reusable components for distributed, durable, and agentic AI applications across all cloud service providers
Create low-latency, interactive user experiences for stateless microservices.
Based on the proxy gateway service of dubbo-go, it solves the problem that the external protocol calls the internal Dubbo cluster. At present, it supports HTTP and gRPC[developing].
This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language
๐ Super Boilerplate ๐ - Goodbye rote memorization Java Full Stack tech knowledge base! Over 1 million words of explanation, principle analysis + rich code examples + clear flowchart illustrations, helping you truly understand every technical point!
Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
E-commerce Big Data Real-time Product Recommendation System, Vue + TypeScript + ElementUI + Spring + Spark
A blazing fast tool for building data pipelines: read, process and output events. Our community: https://t.me/file_d_community
A resilient Ethereum event listener that bridges your smart contract events and backend microservices
GlassFlow ETL: Open source data ingestion and transformations for ClickHouse pipelines
ReplicaDB is an open-source tool for database replication, designed to efficiently transfer bulk data between relational and non-relational databases.
Kafka storage rebalancing, automated replication throttle, cluster API and more