RelBench: Relational Deep Learning Benchmark
A curated list of awesome leaderboard-oriented resources for AI domain
RGB-D Salient Object Detection: A Survey
STREAM, for lots of devices written in many programming models
AI Cluster deployed with Ansible on Random computers with random capabilities
[ICML 2026 Oral] Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence
Face landmarks(fiducial points) detection benchmark
Compression Benchmark
Puck is a high-performance ANN search engine
Framework for benchmarking vector search engines
Join Order Benchmark (JOB)
TPC-DS benchmark kit with some modifications/fixes
Fast, comprehensive DNS performance testing with DNSSEC validation, DoH/DoT support, and enterprise features
An open-source toolbox for fast sampling of diffusion models. Official implementations of our works published in ICML'24, NeurIPS'24, CVPR'24, J. Stat...
Supplementary material for our paper "THERE IS NO DATA LIKE MORE DATA" is provided.
Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)
:twisted_rightwards_arrows: Convert small PNG images to SVG Tiny 1.2
Your defacto guide on monorepos, and in depth feature comparisons of tooling solutions.
[Neurips 2023 & TPAMI] T2I-CompBench (++) for Compositional Text-to-image Generation Evaluation
Scientific machine learning (SciML) benchmarks, AI for science, and (differential) equation solvers. Covers Julia, Python (PyTorch, Jax), MATLAB, R
a high performance library for building cache simulators
[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA...
A ground-truth fuzzing benchmark suite based on real programs with real bugs.
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardw...
Benchmarking PDF libraries
Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Faster than memcpy!
Framework of performance testing
A lightweight, scalable, and general framework for visual question answering research
It's just a simple regex benchmark of different programming languages.
[TKDD 2023] Dynamic Graph Convolutional Recurrent Network for Traffic Prediction: Benchmark and Solution
Sysbench scripts to generate a tpcc-like workload for MySQL and PostgreSQL
Golang benchmarks used for optimizing code
Advanced benchmarks for +15 Go ORMs.
Automated CIS Benchmark Compliance Remediation for RHEL 8 with Ansible
Official code repository of < CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph >
Benchmarking physical understanding in generative video models
A framework for reproducible, comparable benchmarks
Visually explore your JMH Benchmarks
CLI tool for a high QPS DNS benchmark
💥Performance testing tool (Go), It is also a GUI gRPC client.
Comprehensive benchmarks of C++ maps
A small OpenCL benchmark program to measure peak GPU/CPU performance.
Lanczos Network, Graph Neural Networks, Deep Graph Convolutional Networks, Deep Learning on Graph Structured Data, QM8 Quantum Chemistry Benchmark, IC...
Research infra for creating RL environments, post-training, and evals.
MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents
Time-Series Anomaly Detection | Algorithms + Datasets + Tutorials
Standardized environment infrastructure for Agentic AI development.
[ECCV 2022] Map-free Visual Relocalization: Metric Pose Relative to a Single Image
Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测,知己知彼。A unified benchmark framework for ASR/TTS...
[NeurIPS'24 Spotlight] A comprehensive benchmark & codebase for Image manipulation detection/localization.