Topic

benchmark

Repositories (1891)

benchmarks
benchmarks lmdbjava Shell

Benchmark of open source, embedded, memory-mapped, key-value stores available from Java (JMH)

144
framework-benchmarks
framework-benchmarks lissy93 Python

🌈 The same app built in 10 different frontend frameworks. For automated performance benchmarking

144
TAB
TAB decisionintelligence Jupyter Notebook

[PVLDB 2025] TAB: Unified Benchmarking of Time Series Anomaly Detection Methods

144
video-quality-metrics
video-quality-metrics CrypticSignal Python

Uses FFmpeg to benchmark video encoders to compare VMAF, SSIM and PSNR with different encoder settings.

143
contender
contender flashbots Rust

spam EVM execution nodes over JSON-RPC & run benchmarks

143
jsbench-me
jsbench-me psiho

jsbench.me - JavaScript performance benchmarking playground

143
facies_classification_benchmark
facies_classification_benchmark yalaudah Python

The repository includes PyTorch code, and the data, to reproduce the results for our paper titled "A Machine Learning Benchmark for Facies Classificat...

143
php-orm-benchmark
php-orm-benchmark kenjis PHP

PHP ORM Benchmark

143
xbench-evals
xbench-evals xbench-ai Python

Evergreen, contamination-free, real-world, domain-specific AI evaluation framework

142
service-mesh-benchmark
service-mesh-benchmark kinvolk Shell
142
DSRL
DSRL liuzuxin Python

🔥 Datasets and env wrappers for offline safe reinforcement learning

141
Touchstone
Touchstone MrGiovanni Jupyter Notebook

[NeurIPS 2024] Touchstone - Benchmarking AI on 5,172 o.o.d. CT volumes and 9 anatomical structures

140
Video-Bench
Video-Bench PKU-YuanGroup Python

A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!

140
MTAD
MTAD OpsPAI Python

MTAD: Tools and Benchmark for Multivariate Time Series Anomaly Detection

139
MIKASA-Robo
MIKASA-Robo CognitiveAISystems Python

🔥 [ICLR 2026] Benchmark for robotic tabletop manipulation memory-intensive tasks

139
openbench
openbench minghinmatthewlam Python

Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on corre...

138
cadgenbench
cadgenbench huggingface Python

A benchmark for AI-driven CAD generation and editing

138
SpatialBench
SpatialBench Ropedia Python

[NeurIPS 2026] SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

138
PHP-Frameworks-Bench
PHP-Frameworks-Bench myaaghubi PHP

A library to make benchmarks from PHP frameworks.

138
awesome-world-model-evolution
awesome-world-model-evolution OpenRaiser

🌟 [Survey] A curated collection of research papers, models, and resources tracing the evolution from specialized models to unified world models.

137
go-perftuner
go-perftuner go-perf Go

Helper tool for manual Go code optimization.

137
typescript-orm-benchmark
typescript-orm-benchmark emanuelcasco TypeScript

⚖️ ORM benchmarking for Node.js applications written in TypeScript

137
cropandweed-dataset
cropandweed-dataset cropandweed Python

[WACV 2023] Information and scripts for the CropAndWeed Dataset

135
arewefastyet
arewefastyet mozilla JavaScript

NOT MAINTAINED ANYMORE! New project is located on https://github.com/mozilla-frontend-infra/js-perf-dashboard -- AreWeFastYet is a set of tools used f...

135
pglib-uc
pglib-uc power-grid-lib Python

Benchmarks for the Unit Commitment Problem

134
vlsa-aegis
vlsa-aegis THU-RCSCT Python

A vision-language-safety action architecture, named AEGIS, which contains a plug-and-play safety constraint layer formulated via control barrier funct...

134
sec-code-bench
sec-code-bench alibaba Python

SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).

134
THST
THST tuxalin C++

Templated hierarchical spatial trees designed for high-peformance.

133
golang-graphql-benchmark
golang-graphql-benchmark appleboy Go

benchmark of golang GraphQL framework.

133
FinTSB
FinTSB TongjiFinLab Python

PyTorch Implementation of "FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecasting" (FCS & ICAIF 2025 Workshop Best Pape...

133
jvm-performance-benchmarks
jvm-performance-benchmarks ionutbalosin Java

Java Virtual Machine (JVM) Performance Benchmarks with a primary focus on top-tier Just-In-Time (JIT) Compilers, such as C2 JIT, Graal JIT, and the Fa...

132
actors
actors plokhotnyuk Scala

Evaluation of API and performance of different actor libraries

132
ChinaTravel
ChinaTravel LAMDA-NeSy Python

ChinaTravel: A Real-World Benchmark for Language Agents in Chinese Travel Planning

132
MVP_Benchmark
MVP_Benchmark paul007pl Python

MVP Benchmark for Multi-View Partial Point Cloud Completion and Registration

132
aws-bench
aws-bench aws-bench Python

aws-bench measures how well AI agents and model combinations perform on real AWS work — diagnosing misconfigurations, provisioning infrastructure, and...

132
autoguardrails
autoguardrails SantanderAI Python

Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

131
DSBench
DSBench LiqiangJing Jupyter Notebook

[ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?

130
MM-NIAH
MM-NIAH OpenGVLab Python

[NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of existing MLL...

130
JL1-CD
JL1-CD circleLZY Python

Official implementation for "JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Framework"

130
RA-Bench
RA-Bench Shuo-Liang-0111 Python

Real-event-anchored benchmark for detecting AI-generated videos in real-world crisis settings.

129
agent-memory-benchmark
agent-memory-benchmark vectorize-io Python

Agent Memory Benchmark

129
quantum-benchmarks
quantum-benchmarks yardstiq OpenQASM

benchmarking quantum circuit emulators for your daily research usage

129
less_slow.py
less_slow.py ashvardanian Python

Playing around "Less Slow" coding practices in Python, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines

128
RealPDEBench
RealPDEBench AI4Science-WestlakeU Python

[🔥ICLR26 Oral] RealPDEBench: A Benchmark for Complex Physical Systems with Paired Real-World and Simulated Data

128
flo
flo wkwan Rust

Fast Vulkan 3D Renderer Integrated with the Bevy Game Engine

127
factory_bot_instruments
factory_bot_instruments shiroyasha Ruby

Instruments for benchmarking, tracing, and debugging Factory Girl models.

127
optimum-transformers
optimum-transformers AlekseyKorshuk Python

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

126
MMLU-CF
MMLU-CF microsoft

A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]

126
PerformanceBenchmarkReporter
PerformanceBenchmarkReporter Unity-Technologies JavaScript

The Unity Performance Benchmark tool enables partners and developers to establish benchmark samples and measurements using the Performance Testing pac...

126
dc-rl
dc-rl HewlettPackard HTML

SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes cust...

126