Most popular benchmark repositories and open source projects

saca-bench kurpicz Shell

Collection of Suffix Array Construction Algorithms (SACAs)

33 4 33

cmdbench manzik Python

Quick and easy resource usage monitoring and benchmarking for any command's CPU, memory, disk usage and runtime.

33 6 33

videocube-toolkit huuuuusy Python

The official python toolkit for running experiments and evaluate performance on VideoCube benchmark @TPAMI2023

33 6 33

criterion-table nu11ptr Rust

Generate markdown comparison tables from `cargo-criterion` JSON output

33 3 33

imread_benchmark ternaus Python

I/O benchmark for different image processing python libraries.

33 4 33

BeHonest GAIR-NLP JavaScript

BeHonest: Benchmarking Honesty in Large Language Models

33 0 33

critdd mirkobunse Python

Critical difference diagrams with Python and Tikz

33 3 33

cpp2lua-buindings-battle bagobor C++

Lua <-> C++ bindings libraries benchmark

32 1 32

go-test-driven-development gunjan5 Go

:hammer: :wrench: Test Driven Development :repeat: with Golang :hamster:

32 7 1

swords p-lambda Python

The Stanford Word Substitution (Swords) Benchmark

32 6 32

gwvault GoodwayGroup Go

ansible-vault CLI reimplemented in go

32 10 32

powerqe ryanxingql Python

An unified framework of quality enhancement approaches for compressed images based on PyTorch.

32 1 32

Python-Complementary-Languages 00sapo Python

Just a small test to see which language is better for extending python when using lists of lists

32 6 2

NYU-VPR ai4ce Python

[IROS2021] NYU-VPR: Long-Term Visual Place Recognition Benchmark with View Direction and Data Anonymization Influences

32 3 32

useb UKPLab Python

Heterogenous, Task- and Domain-Specific Benchmark for Unsupervised Sentence Embeddings used in the TSDAE paper: https://arxiv.org/abs/2104.06979.

32 2 32

OpenFed FederalLab Python

A Comprehensive and Versatile Open-Source Federated Learning Framework

32 3 32

HPO-B machinelearningnuremberg Python

[NeurIPS DBT 2021] HPO-B

32 9 32

divergent lechmazur

LLM Divergent Thinking Creativity Benchmark. LLMs generate 25 unique words that start with a given letter with no connections to each other or to 50 i...

32 1 32

VCR tianyu-z Python

Official Repo for the paper: VCR: Visual Caption Restoration. Check arxiv.org/pdf/2406.06462 for details.

32 2 32

llm-compressive liyucheng09 Python

Longitudinal Evaluation of LLMs via Data Compression

32 0 32

wasm-score bytecodealliance C

A benchmark for standalone WebAssembly

32 5 32

Cotempqa zhaochen0110 Python

Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)

32 1 32

ECS.CSharp.Benchmark-common-use-cases friflo C#

C# ECS Benchmarks

32 4 32

spurious_imagenet YanNeu Python

Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet

32 1 32

rapidash Acanguven TypeScript

🔥 Collection of useful javascript snippets with automated benchmarks

31 12 3

CellBench Shians HTML

R package for benchmarking single cell analysis methods

31 6 31

TriageSQL yszh8 Python

The dataset and source code for our paper: "Did You Ask a Good Question? A Cross-Domain Question IntentionClassification Benchmark for Text-to-SQL"

31 4 31

arline_benchmarks ArlineQ Python

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined h...

31 9 31

LinGBM LiUGraphQL Java

Linköping GraphQL Benchmark (LinGBM)

31 4 31

kino_benchee livebook-dev Elixir

Benchee (Elixir benchmarking) integration for Livebook

31 7 31

benchmark-vfm-ss tue-mps Python

31 1 31

isitfast yamiteru Jupyter Notebook

A modular benchmarking library with V8 warmup and cpu/ram denoising for the most accurate and consistent results.

31 2 31

Camel-Bench mbzuai-oryx Python

[NAACL 2025 🔥] CAMEL-Bench is an Arabic benchmark for evaluating multimodal models across eight domains with 29,000 questions.

31 1 31

NewsBench IAAR-Shanghai Python

[ACL 2024 Main] NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism

31 1 31

benchmark-kit phpbenchmarks Twig

phpbenchmarks.com kit to add your benchmark.

30 5 30

corebench deckarep Go

corebench - run your benchmarks against high performance computing servers with many CPU cores

30 2 30

thread-pool-benchmark Red-Portal C++

A C++ Thread Pool Colosseum

30 6 30

DACBench automl PDDL

A benchmark library for Dynamic Algorithm Configuration.

30 14 30

user-agent-parser-benchmarks kenjis PHP

PHP User Agent Parser Benchmarks

29 4 29

golden disruptek Nim

a benchmark for compile-time and/or runtime Nim 🏆

29 0 3

qmlbench CrimsonAS QML

Tool to easily benchmark QML/QtQuick (or your own QML components) performance on different hardware.

29 10 11

sim-parameter-estimation NVlabs Python

The code accompaniment for the CoRL 2020 paper: A User's Guide to Calibrating Robotics Simulators (https://arxiv.org/abs/2011.08985), from NVIDIA Rese...

29 2 29