MLLM-CompBench

benchmark

[NeurIPS'25] MLLM-CompBench evaluates the comparative reasoning of MLLMs with 40K image pairs and questions across 8 dimensions of relative comparison: visual attribute, existence, state, emotion, temporality, spatiality, quantity, and quality. CompBench covers diverse visual domains, including animals, fashion, sports, and scenes

How to download and setup MLLM-CompBench

Open terminal and run command

git clone https://github.com/RaptorMai/MLLM-CompBench.git

git clone is used to create a copy or clone of MLLM-CompBench repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with MLLM-CompBench https://github.com/RaptorMai/MLLM-CompBench/archive/master.zip

Or simply clone MLLM-CompBench with SSH

[email protected]:RaptorMai/MLLM-CompBench.git

If you have some problems with MLLM-CompBench

You may open issue on MLLM-CompBench support forum (system) here: https://github.com/RaptorMai/MLLM-CompBench/issues

Similar to MLLM-CompBench repositories

Here you may see MLLM-CompBench alternatives and analogs

netdata primesieve fashion-mnist FrameworkBenchmarks BenchmarkDotNet jmeter awesome-semantic-segmentation sysbench hyperfine tsung benchmark_results across web-frameworks php-framework-benchmark jsperf.com go-web-framework-benchmark huststore phoronix-test-suite Attabench ann-benchmarks sbt-jmh caffenet-benchmark chillout IocPerformance prophiler TBCF NBench sympact awesome-http-benchmark BlurTestAndroid