#kafka Repositories
197 repositories total
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Surging is a micro-service engine that provides a lightweight, high-performance, modular RPC request pipeline. support Event-based Asynchronous Pattern and reactive programming.
Big Data Learning, Learn Big Data from Scratch, Includes Learning Videos and Interview Materials for Each Stage of Big Data Learning
A AI-Driven, Distributed and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.
franz-go is a feature-complete, pure Go library for Kafka versions 0.8.0 through 4.4+. It supports producing, consuming, transactions, administration, and more.
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
The "Java Interview Cheat Sheet" is a summary of interviews that leads you to your ideal Internet company, including Java basics, Java concurrency, JVM, MySQL, Redis, Spring, MyBatis, Kafka, Computer Operating Systems, Computer Networks, System Design, Distributed Systems, Java Project Practice, etc.
Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.
Full-stack .NET 10 Clean Architecture (Microservices, Modular Monolith, Monolith), Blazor, Angular 22, React 19, Vue 3.5, BFF with YARP, Next.js 16, Mobile (React Native, Flutter, Kotlin, MAUI), Domain-Driven Design, CQRS, SOLID, OpenID Connect, EF Core, OpenTelemetry, SignalR, Health Checks, Rate Limiting, Cloud Platforms (Azure, AWS, GCP), ...
Metering and Billing for AI, API and DevOps. Collect and aggregate millions of usage events in real-time and enable usage-based billing.
syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
The fastest unified streaming SQL engine in a single C++ binary. โก Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.
Postgres change data capture to streams, queues, and search indexes like Kafka, SQS, Elasticsearch, HTTP endpoints, and more
Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro
Fancy stream processing made operationally mundane. This repository is a fork of the original project before the license was changed.
OLake Go: open-source replication from databases, Kafka, and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.
A swiss army knife CLI tool for interacting with Kafka, RabbitMQ and other messaging systems.
High-performance multi-data-source database client โ ~30MB, AI & MCP ready, zero Electron bloat.
โ๏ธ Java Engineer Essential Architecture System Knowledge Summary: Covers common architectures in internet companies such as distributed systems, microservices, RPC, as well as essential skills like data storage, caching, and search
Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, , 20+ connectors
A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
Communication infrastructure for the AI era โ one binary, one broker, one storage layer, any protocol
The Big Data knowledge repository involves data warehouse modeling, real-time computing, Big Data, data middle platform, system design, Java, algorithms, etc.
Front-end performance monitoring system, message queue, high availability, cluster, etc. related architectures
Vanus is a Serverless, event streaming system with processing capabilities. It easily connects SaaS, Cloud Services, and Databases to help users build next-gen Event-driven Applications.
๐ฆ A lightweight, streaming-native, multi-protocol gateway for AI, APIs, and real-time data. Route LLM requests across providers, govern MCP tools, and connect Kafka, MQTT, and HTTP through one high-performance engine with shared security and observability.
Trench โ Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events. Easily build product analytics dashboards, LLM RAGs, observability platforms, or any other analytics product.
Scripts and samples to support Confluent Demos, Talks, and Blogs. Not all of the examples in this repository are kept up to date. For automated tutorials and QA'd code, see https://github.com/confluentinc/tutorials/
Test your code without writing mocks with ephemeral Docker containers ๐ฆ Setup popular services with just a couple lines of code โฑ๏ธ No bash, no yaml, only code ๐ป