#distributed-systems Repositories
524 repositories total
Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMs. Store compute as Wi-Fi
Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Container Platform, making it easier to perform browser automation at scale
โญ [Published Book] JD Purchase Link: https://item.jd.com/14531549.html. In-depth explanation of cloud-native technologies such as kernel networking, Kubernetes, ServiceMesh, and containers. A practice-tested development guide for 'large-scale distributed systems'.
Manage local application configuration files using templates and data from etcd or consul
๐ช An orchestration engine for background tasks, AI agents, and durable workflows
ใIn-Depth Understanding of AI Infrastructure: Quantitative Analysis and System Designใ (by Li Bojie), an open-source book manuscript: Starting from hardware constraints and model architectures, it quantitatively derives the design of LLM inference and training systems. Includes the full text, PDF, accompanying computational tools, and experiments.
Alibaba Distributed Database Synchronization System (Solves China-USๅผๅฐๆบๆฟ Issues)
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data
Spring Boot framework combined with other components such as JPA, MyBatis, WebSocket, Security, Shiro, Cache, etc.
A JSON-like data structure (a CRDT) that can be modified concurrently by different users, and merged again automatically.
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL.
Systems design is the process of defining the architecture, modules, interfaces, and data for a system to satisfy specified requirements. Systems design could be seen as the application of systems theory to product development.
Message push platform๐ฅ pushes message types such as [Email][SMS][WeChat Official Account][WeChat Mini Program][Enterprise WeChat][DingTalk].
Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Techniques and numbers for estimating system's performance from first-principles
A cross-language remote procedure call(RPC) framework for rapid development of high performance distributed services.
Full-featured Socket.IO Client Library for Java, which is compatible with Socket.IO v1.0 and later.
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
๐ฆ event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.