#language-model Repositories
139 repositories total
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.
A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
Wanxiang Pinyin Data and Tools Center: Extended Simplified/Traditional Chinese Vocabulary / Tone Encoding / Tone Annotation Toolchain / Wanxiang Update Toolchain / Rime Grammar Model
Unofficial API Wrapper for Perplexity.ai + Account Generator with Web Interface
[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs
Create architecture diagrams from code automatically using large language models (LLMs).
Chinese dialogue 0.2B small model (ChatLM-Chinese-0.2B), open-sourcing all code for all processes such as dataset sources, data cleaning, tokenizer training, model pre-training, SFT instruction fine-tuning, RLHF optimization, etc. Supports sft fine-tuning for downstream tasks and provides an example of fine-tuning for triple information extraction.
[EMNLP 2025 Oral] MemoryOS is designed to provide a memory operating system for personalized AI agents.
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B
The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
A curriculum for learning about foundation models, from scratch to the frontier
๐ธ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Cramming the training of a (BERT-type) language model into limited compute.
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
List of language agents based on paper "Cognitive Architectures for Language Agents"
๐ Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. ๐ซโ๏ธ
Z80-ฮผLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.
A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting with tools [ICLR'24].
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
[support ollama/other model] Integrate any model with OpenAI API calling method into PotPlayer. It enables you to translate subtitles on-the-fly while watching videos, breaking language barriers and enhancing your viewing experience.
A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!
ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.
Selected more than 10k+ projects, including machine learning, deep learning, NLP, GNN, recommendation system, biomedicine, machine vision, frontend and backend development, etc. Let more excellent projects be discovered by people. Continue to update! Welcome to star!
Language models for Chinese input methods: corpora, n-gram statistics, character-level neural models, and evaluation sets for assessing their quality