Git Stars Git Stars

#robots-txt Repositories

Discover 7 active open source GitHub repositories tagged with #robots-txt, accumulating 10,665 total stars (averaging 1,523 stars per project). Leading this topic is google/robotstxt with 3,478 stars.

7
Total Repositories
10,665
Total Stars
1,523
Avg Stars/Repo
1
google/robotstxt

The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).

google
โญ 3,478 C++ ๐Ÿ‘ค google Organization ๐Ÿ• Updated 2026-04-01 ๐Ÿ“… Created 2019-06-11
2
i365dev/awesome-seo

Curated resources on SEO, GEO, and AI search โ€” technical SEO, agent discoverability, analytics, and traffic monetization.

i365dev
โญ 2,869 ๐Ÿ‘ค i365dev Organization ๐Ÿ• Updated 2026-10-21 ๐Ÿ“… Created 2021-01-06
3
eliasdabbas/advertools

advertools - online marketing productivity and analysis tools

eliasdabbas
โญ 1,508 Python ๐Ÿ‘ค eliasdabbas User ๐Ÿ• Updated 2026-06-30 ๐Ÿ“… Created 2017-05-14
4
thedaviddias/llms-txt-hub

The largest directory for AI-ready documentation and tools implementing the proposed llms.txt standard

thedaviddias
โญ 930 TypeScript ๐Ÿ‘ค thedaviddias User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2025-02-20
5
python-mechanize/mechanize

The official source code for the python-mechanize project

python-mechanize
โญ 760 Python ๐Ÿ‘ค python-mechanize Organization ๐Ÿ• Updated 2026-11-16 ๐Ÿ“… Created 2017-03-08
6
umutxyp/Seo-Promt-Master

Open-source SEO & GEO audit: a zero-dependency CLI (npx), an agent skill for Claude Code, Cursor, Codex, Gemini & Copilot, 47 SEO prompts and a cited Google/Bing/AI-search knowledge base. Checks robots.txt, sitemaps, canonicals, hreflang, structured data, Core Web Vitals and AI crawlers โ€” then fixes them.

umutxyp
โญ 595 JavaScript ๐Ÿ‘ค umutxyp User ๐Ÿ• Updated 2026-11-21 ๐Ÿ“… Created 2022-03-18
7
nuxt-modules/robots

Tame the robots crawling and indexing your Nuxt site.

nuxt-modules
โญ 529 TypeScript ๐Ÿ‘ค nuxt-modules Organization ๐Ÿ• Updated 2026-11-19 ๐Ÿ“… Created 2017-10-24

Frequently Asked Questions

1

What is the most popular #robots-txt repository on GitHub?

The top ranked open source #robots-txt project on GitHub is google/robotstxt with 3,478 stars. The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).

2

Which programming languages are most used in #robots-txt repositories?

Among the top ranked #robots-txt projects on GitHub, the most common programming languages are Python, TypeScript, C++, JavaScript.

3

How is the #robots-txt repository ranking calculated?

We track 7 active open source repositories tagged with #robots-txt (500+ stars), totaling 10,665 stars with an average of 1,523 stars per repository. Rankings update daily from the GitHub API.