benchmark
Repositories (1763)
🔥 Datasets and env wrappers for offline safe reinforcement learning
MVP Benchmark for Multi-View Partial Point Cloud Completion and Registration
benchmarking quantum circuit emulators for your daily research usage
A library to make benchmarks from PHP frameworks.
[PVLDB 2025] TAB: Unified Benchmarking of Time Series Anomaly Detection Methods
Instruments for benchmarking, tracing, and debugging Factory Girl models.
FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecasting (ICAIF'25 Workshop Best Paper)
Volley is a benchmarking tool for measuring the performance of server networking stacks.
[FSE'26, WWW'25, ASE'24] RCAEval: A Benchmark for Root Cause Analysis.
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
HaluMem is the first operation level hallucination evaluation benchmark tailored to agent memory systems.
A modular toolbox for meta-learning research with a focus on speed and reproducibility.
[TPAMI 2022] "Bag of Tricks for Training Deeper Graph Neural Networks A Comprehensive Benchmark Study" by Tianlong Chen*, Kaixiong Zhou*, Keyu Duan, W...
The Unity Performance Benchmark tool enables partners and developers to establish benchmark samples and measurements using the Performance Testing pac...
[NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of existing MLL...
A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]
Playing around "Less Slow" coding practices in Python, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines
[ICRA2021] A unified benchmark for the evaluation of mobile robot local planning approaches
Always up-to-date, most comprehensive HAR resource — continuously scanned and auto-updated from Papers with Code. 53 datasets integrated across all mo...
Playing around "Less Slow" coding practices in Rust, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines
Python-based portfolio / stock widget which sources data from Yahoo Finance and calculates different types of Value-at-Risk (VaR) metrics and many oth...
CORe50: a new Dataset and Benchmark for Continual Learning
Benchmarks for the Unit Commitment Problem
This is the official repo for the paper "AMO-Bench: Large Language Models Still Struggle in High School Math Competitions".
The official implementation of the ACM MM'21 paper Co-learning: Learning from noisy labels with self-supervision.
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of prote...
Official implementation for "JL1-CD: A New Benchmark for Remote Sensing Change Detection and a Robust Multi-Teacher Knowledge Distillation Framework"
🔥🔥🔥 Latest Advances on Large Recommendation Models
Automated STIG Benchmark Compliance Remediation for RHEL 8 with Ansible
Test/benchmark regression and comparison system with dashboard
UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texture
Meter - is a simple micro-benchmarking tool for Android (and Java) projects. This is not a profiler, this is very small utility class that designed fo...
[ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
Simple comparison of code execution speed between different options
CPU Ultimate Latency Test.
[NeurIPS 2025] Official repository of RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents
A benchmark for role-playing language models
UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic
Simple HTTP benchmark for different nodejs frameworks using wrk
Shuhai is a benchmarking-memory tool that allows FPGA programmers to demystify all the underlying details of memories, e.g., HBM and DDR4, on a Xilinx...
Benchmark CS:GO on any map
measure startup time of your react-native app
[ICLR 2025] DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
Sample benchmark files for Hyperledger Caliper https://wiki.hyperledger.org/display/caliper
🏋️ dbbench is a simple database benchmarking tool which supports several databases and own scripts
[WACV 2023] Information and scripts for the CropAndWeed Dataset
S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models
A tool for benchmarking the render performance of React components
Challenging Memory-based Deep Reinforcement Learning Agents
OceanGym: A Benchmark Environment for Underwater Embodied Agents