Topic

benchmark

Repositories (1837)

relbench
relbench stanford-star Python

RelBench: Relational Deep Learning Benchmark

379
awesome-ai-leaderboard
awesome-ai-leaderboard SAILResearch

A curated list of awesome leaderboard-oriented resources for AI domain

377
RGBD-SODsurvey
RGBD-SODsurvey taozh2017 MATLAB

RGB-D Salient Object Detection: A Survey

375
BabelStream
BabelStream UoB-HPC C++

STREAM, for lots of devices written in many programming models

374
beowulf-ai-cluster
beowulf-ai-cluster geerlingguy Jinja

AI Cluster deployed with Ansible on Random computers with random capabilities

374
holi-spatial
holi-spatial Visionary-Laboratory Python

[ICML 2026 Oral] Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence

373
Face-landmarks-detection-benchmark
Face-landmarks-detection-benchmark mrgloom

Face landmarks(fiducial points) detection benchmark

372
TurboBench
TurboBench powturbo C

Compression Benchmark

371
puck
puck baidu Jupyter Notebook

Puck is a high-performance ANN search engine

371
vector-db-benchmark
vector-db-benchmark qdrant Python

Framework for benchmarking vector search engines

368
join-order-benchmark
join-order-benchmark gregrahn

Join Order Benchmark (JOB)

366
tpcds-kit
tpcds-kit gregrahn C

TPC-DS benchmark kit with some modifications/fixes

364
dns-benchmark-tool
dns-benchmark-tool net-benchmark Python

Fast, comprehensive DNS performance testing with DNSSEC validation, DoH/DoT support, and enterprise features

363
diff-sampler
diff-sampler zju-pi Jupyter Notebook

An open-source toolbox for fast sampling of diffusion models. Official implementations of our works published in ICML'24, NeurIPS'24, CVPR'24, J. Stat...

363
Awesome_Satellite_Benchmark_Datasets
Awesome_Satellite_Benchmark_Datasets Seyed-Ali-Ahmadi Jupyter Notebook

Supplementary material for our paper "THERE IS NO DATA LIKE MORE DATA" is provided.

363
model-vs-human
model-vs-human bethgelab Python

Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)

362
png2svg
png2svg xyproto Go

:twisted_rightwards_arrows: Convert small PNG images to SVG Tiny 1.2

357
monorepo.tools
monorepo.tools nrwl TypeScript

Your defacto guide on monorepos, and in depth feature comparisons of tooling solutions.

354
T2I-CompBench
T2I-CompBench Karine-Huang Python

[Neurips 2023 & TPAMI] T2I-CompBench (++) for Compositional Text-to-image Generation Evaluation

345
SciMLBenchmarks.jl
SciMLBenchmarks.jl SciML MATLAB

Scientific machine learning (SciML) benchmarks, AI for science, and (differential) equation solvers. Covers Julia, Python (PyTorch, Jax), MATLAB, R

344
libCacheSim
libCacheSim 1a1a11a C++

a high performance library for building cache simulators

343
HallusionBench
HallusionBench tianyi-lab Python

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA...

342
magma
magma HexHive HTML

A ground-truth fuzzing benchmark suite based on real programs with real bugs.

342
optimum-benchmark
optimum-benchmark huggingface Python

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardw...

339
benchmarks
benchmarks py-pdf Python

Benchmarking PDF libraries

338
Turbo-Base64
Turbo-Base64 powturbo C

Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Faster than memcpy!

336
fperf
fperf fperf Go

Framework of performance testing

335
openvqa
openvqa MILVLG Python

A lightweight, scalable, and general framework for visual question answering research

334
regex-benchmark
regex-benchmark mariomka Dockerfile

It's just a simple regex benchmark of different programming languages.

334
Traffic-Benchmark
Traffic-Benchmark tsinghua-fib-lab Python

[TKDD 2023] Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solution

333
sysbench-tpcc
sysbench-tpcc Percona-Lab Lua

Sysbench scripts to generate a tpcc-like workload for MySQL and PostgreSQL

331
go-benchmark
go-benchmark cornelk Go

Golang benchmarks used for optimizing code

329
go-orm-benchmarks
go-orm-benchmarks efectn Go

Advanced benchmarks for +15 Go ORMs.

329
RHEL8-CIS
RHEL8-CIS ansible-lockdown YAML

Automated CIS Benchmark Compliance Remediation for RHEL 8 with Ansible

328
CBGBench
CBGBench EDAPINENUT Python

Official code repository of < CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph >

328
physics-IQ-benchmark
physics-IQ-benchmark google-deepmind Python

Benchmarking physical understanding in generative video models

327
benchopt
benchopt benchopt Python

A framework for reproducible, comparable benchmarks

326
jmh-visualizer
jmh-visualizer jzillmann JavaScript

Visually explore your JMH Benchmarks

325
dnspyre
dnspyre Tantalor93 Go

CLI tool for a high QPS DNS benchmark

325
ptg
ptg crossoverJie Go

💥Performance testing tool (Go), It is also a GUI gRPC client.

324
map_benchmark
map_benchmark martinus C++

Comprehensive benchmarks of C++ maps

321
OpenCL-Benchmark
OpenCL-Benchmark ProjectPhysX C++

A small OpenCL benchmark program to measure peak GPU/CPU performance.

318
LanczosNetwork
LanczosNetwork lrjconan Python

Lanczos Network, Graph Neural Networks, Deep Graph Convolutional Networks, Deep Learning on Graph Structured Data, QM8 Quantum Chemistry Benchmark, IC...

317
benchflow
benchflow benchflow-ai Python

Research infra for creating RL environments, post-training, and evals.

317
MedAgentBench
MedAgentBench stanfordmlgroup Python

MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents

315
TSB-AD
TSB-AD thedatumorg Python

Time-Series Anomaly Detection | Algorithms + Datasets + Tutorials

314
AEnvironment
AEnvironment inclusionAI Python

Standardized environment infrastructure for Agentic AI development.

313
map-free-reloc
map-free-reloc nianticlabs Python

[ECCV 2022] Map-free Visual Relocalization: Metric Pose Relative to a Single Image

312
UltraEval-Audio
UltraEval-Audio OpenBMB Python

Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测,知己知彼。A unified benchmark framework for ASR/TTS...

310
IMDLBenCo
IMDLBenCo scu-zjz Python

[NeurIPS'24 Spotlight] A comprehensive benchmark & codebase for Image manipulation detection/localization.

310