#evaluation-metrics Repositories
Discover 18 active open source GitHub repositories tagged with #evaluation-metrics, accumulating 46,395 total stars (averaging 2,577 stars per project). Leading this topic is confident-ai/deepeval with 19,585 stars.
18 repositories total
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
"Big Model White-Box Construction Guide": A completely hand-built Tiny-Universe
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New Evaluation Metrics"
Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
Evaluation functions for music/audio information retrieval/signal processing algorithms.
โก๏ธA Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion ๐
:chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
Frequently Asked Questions
What is the most popular #evaluation-metrics repository on GitHub?
The top ranked open source #evaluation-metrics project on GitHub is confident-ai/deepeval with 19,585 stars. The LLM Evaluation Framework
Which programming languages are most used in #evaluation-metrics repositories?
Among the top ranked #evaluation-metrics projects on GitHub, the most common programming languages are Python, Jupyter Notebook.
How is the #evaluation-metrics repository ranking calculated?
We track 18 active open source repositories tagged with #evaluation-metrics (500+ stars), totaling 46,395 stars with an average of 2,577 stars per repository. Rankings update daily from the GitHub API.