#llm-benchmarking Repositories
Discover 17 active open source GitHub repositories tagged with #llm-benchmarking, accumulating 47,048 total stars (averaging 2,767 stars per project). Leading this topic is HKUDS/AI-Trader with 23,345 stars.
17 repositories total
This repo contains the source code for RULER: Whatโs the Real Context Size of Your Long-Context Language Models?
[NeurIPS 2025 Main] SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applications
A benchmark to evaluate language models on questions I've previously asked them to solve.
A framework for the evaluation of autoregressive code generation language models.
A principled instruction benchmark on formulating effective queries and prompts for large language models (LLMs). Our paper: https://arxiv.org/abs/2312.16171
Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
Frequently Asked Questions
What is the most popular #llm-benchmarking repository on GitHub?
The top ranked open source #llm-benchmarking project on GitHub is HKUDS/AI-Trader with 23,345 stars. "AI-Trader: 100% Fully-Automated Agent-Native Trading"
Which programming languages are most used in #llm-benchmarking repositories?
Among the top ranked #llm-benchmarking projects on GitHub, the most common programming languages are Python, Jupyter Notebook, TypeScript.
How is the #llm-benchmarking repository ranking calculated?
We track 17 active open source repositories tagged with #llm-benchmarking (500+ stars), totaling 47,048 stars with an average of 2,767 stars per repository. Rankings update daily from the GitHub API.