#bert Repositories
109 repositories total
[ICLR'23 Spotlight๐ฅ] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using โก PyTorch Lightning and ๐ค Transformers.
Relevant papers in the field of Natural Language Processing (with reading notes), model reproduction, and data processing (code includes both TensorFlow and PyTorch versions)
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions ๐ผ๏ธ
Best practice TTS based on BERT and VITS with some Natural Speech Features Of Microsoft; Support ONNX streaming out!
๐ Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. ๐ซโ๏ธ
Full-stack algorithm tutorial from NLP to LLM, online reading address: https://datawhalechina.github.io/base-llm/
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
Large-scale Pre-Training Corpus for Chinese 100G ไธญๆ้ข่ฎญ็ป่ฏญๆ
Building a Chinese dialogue system based on the newest version of rasa(Building a dialogue system based on the latest version of rasa)
TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. Text generation models, implemented training and prediction of models including LLaMA, ChatGLM, BLOOM, GPT2, Seq2Seq, BART, T5, UDA, etc., ready to use.
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI, HuggingGPT, and more.
Official implementation of the papers "GECToR โ Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)"
A PyTorch library of curated Transformer models and their composable components
Github repo with tutorials to fine tune transformers for diff NLP tasks
Multi-label text classification, multi-label classification, text classification, multi-label, classifier, text classification, BERT, seq2seq, attention, multi-label-classification
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
The prime repository for state-of-the-art Multilingual Question Answering research and development.
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Pytorch implementation of JointBERT: "BERT for Joint Intent Classification and Slot Filling"
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. A curated list of tools, benchmarks/datasets, demos, leaderboards, and large models, primarily focused on the evaluation of foundation large models, aiming to explore the technological boundaries of generative AI.
The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)
Span-level grounding verification for RAG, code, and tool-grounded AI outputs.
An implementation of the BERT model and its related downstream tasks based on the PyTorch framework. @่ทๆๅญฆๆบๅจๅญฆไน
Transformers for Natural Language Processing, published by Packt
A Deep Learning NLP repository that summarizes text preprocessing, Topic Models, and downstream tasks of state-of-the-art models such as BERT, GPT, and LLMs using TensorFlow.
A flexible, adaptive classification system for dynamic text classification
Natural Language Processing with Transformers Chinese translation, the most authoritative Transformers tutorial