#distributed-training Repositories
147 repositories total
๐น A more flexible framework that can generate videos at any resolution and creates videos from images.
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.
ใLLMs Nine-Layered Demon TowerใSharing LLMs practical experiences and knowledge in fields such as Natural Language Processing (ChatGLM, Chinese-LLaMA-Alpaca, Xiaoyangtuo Vicuna, LLaMA, GPT4ALL, etc.), Information Retrieval (langchain), Language Synthesis, Language Recognition, Multimodal (Stable Diffusion, MiniGPT-4, VisualGLM-6B, Ziya-Visual, etc.).
Large Model Algorithm Position Interview Questions (with Answers): Common Questions and Concept Analysis "Large Model Interview Questions", "Algorithm Position Interview", "Common Interview Questions", "Large Model Algorithm Interview", "Large Model Application Fundamentals"
Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
A fully open source framework for creating RL training swarms over the internet.
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
fitlog is a tool used in deep learning training to assist users in logging and managing code.
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
Collective communications library with various primitives for multi-machine training.
DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.
An open infrastructure to democratize and decentralize the development of superintelligence for humanity.
A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training