#text-processing Repositories
113 repositories total
A simple terminal-based open source Spritz-alike (per-word RSVP aligned on optimal reading points)
Morphological analyzer / inflection engine for Russian and Ukrainian languages.
Moqi Phonetic-Shape: Creating the ultimate dual-pinyin auxiliary code Rime input scheme, making auxiliary codes accessible to every dual-pinyin user. Based on the 'Wusong-Baishuang' dictionary, it supports various dual-pinyin layouts like Xiaohe, Ziranma, Sogou, and Microsoft. Auxiliary code support includes Moqi Code (original open-source decomposition for 100,000 characters), Ziranma radicals, and Xiaohe shape codes. It allows flexible combinations of dual-pinyin and auxiliary codes, supporting both phrase and character input. For unknown characters, it offers reverse lookup via strokes, components, or Cangjie codes. Features include 'aw'/'aj' modes for English/Japanese input, dual-pinyin chord typing, emojis, shortcuts, dates, uppercase numbers, and a calculator. Wusong-Xiaohe | Wusong-Ziranma | Moqi Code | Moqi Phonetic-Shape
Guide on using Python for administrative scripting
Easy-to-use, fast, free, unlimited file size and cross platform file translation tool based on Deeplx & Playwright that supports long text translations.
Java implementation of the Aho-Corasick algorithm for efficient string matching
A Chinese input method for Emacs, supporting full Pinyin, Shuangpin, Wubi, Cangjie and Rime. pyim is a GNU ELPA package.
Turn messy, real-world HTML into clean Markdown, from every major language.
A tool for transcribing orthographic text as IPA (International Phonetic Alphabet)
Gรต Nhanh - A modern, high-performance Vietnamese input method for macOS.
C# .NET fuzzy string matching implementation of Seat Geek's well known python FuzzyWuzzy algorithm.
text-humanizer is an open-source project designed to convert AI-generated text into a โhumanizedโ version. It bypasses most AI detectors, such as Turnitin and GPTZero.
InfiniteGPT is a Python script that lets you input an unlimited size text into the OpenAI API. No more tedious copy & pasting. Long live multithreading!
Measure the difference between two strings with the fastest JS implementation of the Levenshtein distance algorithm
Easily handle day to day CLI operation via Python instead of regular Bash programs. ๐บ๐ฆ #supporting
Parse human names into title, given, middle, family, suffix, nickname, and maiden name. Typed, zero-dependency, CJK-aware.
Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).
Open Korean Text Processor - An Open-source Korean Text Processor
Turn PDFs and EPUBs into audiobooks; subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.
Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.