evaluation-guidebook

Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

tutorial

View on GitHub

1.6k Stars

92 Forks

1.6k Watchers

Jupyter Notebook Language

other License

Cost to Build

$3.4K

Market Value

$13.5K

How is this calculated?

Growth over time

1 data points · 2025-09-23 → 2025-09-23

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about evaluation-guidebook

Question copied to clipboard

What is the huggingface/evaluation-guidebook GitHub project? Description: "Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!". Written in Jupyter Notebook. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone evaluation-guidebook

Clone via HTTPS

git clone https://github.com/huggingface/evaluation-guidebook.git

Clone via SSH

[email protected]:huggingface/evaluation-guidebook.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the evaluation-guidebook issue tracker:

Open GitHub Issues

Similar to evaluation-guidebook

js-stack-from-scratch N-blog TensorFlow-Examples raspberry-pi-os elm-cheat-sheet java8-tutorial IntelliJ-IDEA-Tutorial first-contributions TensorFlow-Tutorials have-fun-with-machine-learning Kotlin-Tutorials gulp-tutorial 52-technologies-in-2016 digital_video_introduction tinyrenderer react-from-zero catboost mlr All-About-Programming docker-django-nginx-uwsgi-postgres-load-balance-tutorial scrapple project-based-learning Hackintosh-Installer-University ARShooter go_command_tutorial vulkan_minimal_compute the-way-to-go_ZH_CN rust-learning stanford-tensorflow-tutorials RxJava2-Android-Samples