#robots-txt Repositories
Discover 7 active open source GitHub repositories tagged with #robots-txt, accumulating 10,665 total stars (averaging 1,523 stars per project). Leading this topic is google/robotstxt with 3,478 stars.
7 repositories total
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Curated resources on SEO, GEO, and AI search โ technical SEO, agent discoverability, analytics, and traffic monetization.
The largest directory for AI-ready documentation and tools implementing the proposed llms.txt standard
Open-source SEO & GEO audit: a zero-dependency CLI (npx), an agent skill for Claude Code, Cursor, Codex, Gemini & Copilot, 47 SEO prompts and a cited Google/Bing/AI-search knowledge base. Checks robots.txt, sitemaps, canonicals, hreflang, structured data, Core Web Vitals and AI crawlers โ then fixes them.
Frequently Asked Questions
What is the most popular #robots-txt repository on GitHub?
The top ranked open source #robots-txt project on GitHub is google/robotstxt with 3,478 stars. The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Which programming languages are most used in #robots-txt repositories?
Among the top ranked #robots-txt projects on GitHub, the most common programming languages are Python, TypeScript, C++, JavaScript.
How is the #robots-txt repository ranking calculated?
We track 7 active open source repositories tagged with #robots-txt (500+ stars), totaling 10,665 stars with an average of 1,523 stars per repository. Rankings update daily from the GitHub API.