#nlp Repositories
494 repositories total
Large-scale Pre-Training Corpus for Chinese 100G ไธญๆ้ข่ฎญ็ป่ฏญๆ
AI-related tutorials. Access any of them for free โ https://towardsai.net/editorial
๐ A curated collection of free, high quality AI tools ๐ค, APIs ๐, datasets ๐, and learning resources ๐ covering machine learning ๐ง , deep learning ๐งฉ, generative AI ๐จ, NLP ๐ฌ, and data science ๐. Designed to help developers ๐ฉโ๐ป, researchers ๐ฌ, and creators โจ explore and build with AI faster โก.
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
"AI-Compass" will guide the community in navigating the ocean of AI technology. Whether you are a beginner or an advanced developer, you can find a path towards all major AI directions here. It aims to help developers systematically understand AIโs core concepts, mainstream technologies, cuttingโedge trends, and, through practice, master the entire process from theory to implementation.
This is a Python library for Korean natural language processing. It provides functions for word extraction / tokenizer / POS tagging / preprocessing.
๐ LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). ๐ Extracts signals from prompts & responses, ensuring safety & security. ๐ก๏ธ Features include text quality, relevance metrics, & sentiment analysis. ๐ A comprehensive tool for LLM observability. ๐
A tool for learning vector representations of words and entities from Wikipedia
Bolt is a deep learning library with high performance and heterogeneous flexibility.
Selected more than 10k+ projects, including machine learning, deep learning, NLP, GNN, recommendation system, biomedicine, machine vision, frontend and backend development, etc. Let more excellent projects be discovered by people. Continue to update! Welcome to star!
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI, HuggingGPT, and more.
Official implementation of the papers "GECToR โ Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)"
MindSpore + ๐คHuggingface: Run any Transformers/Diffusers model on MindSpore with seamless compatibility and acceleration.
[ไธญๆๆณๅพๅคงๆจกๅ] DISC-LawLLM: an intelligent legal system powered by large language models (LLMs) to provide a wide range of legal services.
Language models for Chinese input methods: corpora, n-gram statistics, character-level neural models, and evaluation sets for assessing their quality
A curated collection of iOS, ML, AR resources sprinkled with some UI additions.
SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.
TextGAN is a PyTorch framework for Generative Adversarial Networks (GANs) based text generation models.
Backend that powers the dataset viewer on Hugging Face dataset pages through a public API.
Similarities: a toolkit for similarity calculation and semantic search. An toolkit for similarity calculation and matching search, supporting billions of data for text-to-text, text-to-image, and image-to-image search. Developed in Python 3, ready to use out of the box.
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
A PyTorch library of curated Transformer models and their composable components
Python bindings to libpostal for fast international address parsing/normalization
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
๐ฅMachine Learning/Deep Learning/Python/Large Models/Multimodal/LLM/Deep Learning/Python/Algorithm Interview/NLP Tutorial
An Eigen-based, light-weight C++ Interface to Nonlinear Programming Solvers (Ipopt, Snopt)
๐ Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!
Github repo with tutorials to fine tune transformers for diff NLP tasks
A language detection library for PHP. Detects the language from a given text string.
DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
We introduced a new model designed for the Code generation task. Its test accuracy on the HumanEval base dataset surpasses that of GPT-4 Turbo (April 2024) and GPT-4o.