#nlp Repositories
494 repositories total
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
"Jieba" Chinese Word Segmentation: Built to be the best PHP Chinese word segmentation and tokenizer component. / "Jieba" (Chinese for "stutter") Chinese text segmentation: built to be the best PHP Chinese word segmentation module.
The Most Comprehensive Learning Path for Agent Engineers ยท Master AI Engineering from Scratch ยท 20 Stages, 542 Lessons ยท Complete Chinese Translation + Companion Website + Animated Explainer Videos ยท A Guide to Becoming an AI Agent Engineer
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using โก PyTorch Lightning and ๐ค Transformers.
Relevant papers in the field of Natural Language Processing (with reading notes), model reproduction, and data processing (code includes both TensorFlow and PyTorch versions)
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).
ktrain is a Python library that makes deep learning and AI more accessible and easier to apply
A list of open-source AI projects you can use to generate income easily.
Taranis AI is an advanced Open-Source Intelligence (OSINT) tool, leveraging Artificial Intelligence to revolutionize information gathering and situational analysis.
Keras implementation of "One pixel attack for fooling deep neural networks" using differential evolution on Cifar10 and ImageNet
Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)
A complete, structured hub for learning Artificial Intelligence โ covering AI, Machine Learning, Deep Learning, and Data Science with books, roadmaps, and curated resources from beginner to advanced.
ChatLLaMA ๐ข Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT
๐ Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. ๐ซโ๏ธ
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
Plug and Play Language Model implementation. Allows to steer topic and attributes of GPT-2 models.
Full-stack algorithm tutorial from NLP to LLM, online reading address: https://datawhalechina.github.io/base-llm/
[Neurips 2023] Generating Mario Levels with GPT2. Code for the paper "MarioGPT: Open-Ended Text2Level Generation through Large Language Models" https://arxiv.org/abs/2302.05981
Z80-ฮผLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.
Algebrica is a free and open mathematical knowledge base dedicated to clarity, structure, and conceptual coherence.
Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.
[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
LLMs Large Models Notes 50 Articles This repository contains practical projects in fields such as machine learning, deep learning, computer vision, natural language processing, large models, web scraping, etc.
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. โ ๐ค๐ค
Awesome-llm-role-playing-with-persona: a curated list of resources for large language models for role-playing with assigned personas
Natural language detection library for Rust. Try demo online: https://whatlang.org/
WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.
๐ค A list of wonderful open-source projects & applications integrated with Hugging Face libraries.
A curated list of resources for Japanese natural language processing (NLP): Python libraries, LLMs, dictionaries, corpora, and datasets. Includes Claude Code and Codex skills to search resources.