#nlp Repositories
494 repositories total
Curated tutorials and resources for Large Language Models, AI Painting, and more.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
This project reproduces the book Dive Into Deep Learning (https://d2l.ai/), adapting the code from MXNet into PyTorch.
MNBVC (Massive Never-ending BT Vast Chinese corpus) ultra-large-scale Chinese corpus. Comparable to the 40T data used for training chatGPT. The MNBVC dataset not only includes mainstream culture but also data from various niche cultures and even Martian text. The MNBVC dataset includes Chinese pure text data in all forms, such as news, essays, novels, books, magazines, papers, scripts, posts, wikis, ancient poetry, lyrics, product introductions, jokes, embarrassing stories, chat logs, and more.
"Build a Large Language Model (From Scratch)" is an e-book that delves into the principles and implementation of large language models, suitable for learners who wish to deeply understand the architecture, training process, and application development of large models like GPT. To enable more Chinese readers to access this highly valuable textbook, I have decided to translate it into Chinese and share it as open source via GitHub.
Superfast AI decision making and intelligent processing of multi-modal data.
Interview experiences compiled by Datawhale members, contents include machine learning, CV, NLP, recommendation, development, etc. Welcome everyone to star
A Chinese NLP Preprocessing & Parsing Package, accurate, efficient, easy to use www.jionlp.com
Chinese NLP Solutions (Large Models, Data, Models, Training, Inference)
Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSLใText2APIใText2Vis and more.
[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
Quick start to AI theory and applied practice: basic knowledge, Transformer, NLP, ML, DL, competitions. Includes abundant annotations and datasets, striving for everyone to understand and reproduce.
Deep Learning introductory courses, advanced courses, featured courses, academic cases, industry practice cases, deep learning knowledge encyclopedia and interview question bank The course, case and knowledge of Deep Learning and AI
Open-source inference server and production cluster for all the models your agent needs.
๐ All-in-one web-based IDE specialized for machine learning and data science.
Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.
TextAttack ๐ is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
[TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.
100 Examples of Deep Learning, Deep Learning DL, Image Classification, Object Recognition, Object Detection, Natural Language Processing NLP, Text Classification, TensorFlow, PyTorch
:book: A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2, ...)
Chinese-LLaMA 1&2, Chinese-Falcon base models; ChatFlow Chinese dialogue model; Chinese OpenLLaMA model; NLP pre-training/instruction fine-tuning datasets
we want to create a repo to illustrate usage of transformers in chinese
Deep Learning and deep reinforcement learning research papers and some codes
Covers pre-training data, Tokenizers, Transformers, MoE, distributed training, scaling laws, inference, and alignment. 6 progressive coding assignments for full-stack LLM learning.
๐ฎ A refreshing functional take on deep learning, compatible with your favorite libraries
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
A library for debugging/inspecting machine learning classifiers and explaining their predictions
Go efficient fast multilingual NLP and text segmentation; support English, Chinese, Japanese and others.
Text mining and preprocessing tools (text cleaning, new word discovery, sentiment analysis, entity recognition linking, keyword extraction, knowledge extraction, syntactic analysis, etc.), unsupervised or weakly supervised methods