MMLU-CF

benchmark

A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]

How to download and setup MMLU-CF

Open terminal and run command

git clone https://github.com/microsoft/MMLU-CF.git

git clone is used to create a copy or clone of MMLU-CF repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with MMLU-CF https://github.com/microsoft/MMLU-CF/archive/master.zip

Or simply clone MMLU-CF with SSH

[email protected]:microsoft/MMLU-CF.git

If you have some problems with MMLU-CF

You may open issue on MMLU-CF support forum (system) here: https://github.com/microsoft/MMLU-CF/issues

Similar to MMLU-CF repositories

Here you may see MMLU-CF alternatives and analogs

netdata primesieve fashion-mnist FrameworkBenchmarks BenchmarkDotNet jmeter awesome-semantic-segmentation sysbench hyperfine tsung benchmark_results across web-frameworks php-framework-benchmark jsperf.com go-web-framework-benchmark huststore phoronix-test-suite Attabench ann-benchmarks sbt-jmh caffenet-benchmark chillout IocPerformance prophiler TBCF NBench sympact awesome-http-benchmark BlurTestAndroid