benchmark

[NeurIPS 2025] Official repository of RiOSWorld: Benchmarking the Risk of Multimodal Computer-Use Agents

[ICRA2021] A unified benchmark for the evaluation of mobile robot local planning approaches

Volley is a benchmarking tool for measuring the performance of server networking stacks.

A modular toolbox for meta-learning research with a focus on speed and reproducibility.

Bug Hunt Bench: 105 real bugs in two production repos, frontier coding models (GPT-6, Claude, Grok, Gemini, DeepSeek...) find and fix them in their ow...

Verification-gated skill routing and self-improvement harness for Hermes-style agent skills

Playing around "Less Slow" coding practices in Rust, from numerical micro-kernels to coroutines, ranges, and polymorphic state machines

[TPAMI 2022] "Bag of Tricks for Training Deeper Graph Neural Networks A Comprehensive Benchmark Study" by Tianlong Chen*, Kaixiong Zhou*, Keyu Duan, W...

CORe50: a new Dataset and Benchmark for Continual Learning

Python-based portfolio / stock widget which sources data from Yahoo Finance and calculates different types of Value-at-Risk (VaR) metrics and many oth...

[ICLR'2025 Spotlight] Official repository for "SVBench: A Benchmark with Temporal Multi-Turn Dialogues for Streaming Video Understanding"

CPU Ultimate Latency Test.

The official implementation of the ACM MM'21 paper Co-learning: Learning from noisy labels with self-supervision.

S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models

🔥🔥🔥 Latest Advances on Large Recommendation Models

The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it, refunded...

A benchmark for role-playing language models

Automated STIG Benchmark Compliance Remediation for RHEL 8 with Ansible

Simple comparison of code execution speed between different options

⚡ Awesome AI Gateway — pick an AI gateway from 160+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, s...

Shuhai is a benchmarking-memory tool that allows FPGA programmers to demystify all the underlying details of memories, e.g., HBM and DDR4, on a Xilinx...

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of prote...

Meter - is a simple micro-benchmarking tool for Android (and Java) projects. This is not a profiler, this is very small utility class that designed fo...

Test/benchmark regression and comparison system with dashboard

[ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models

Set of benchmarks for the Ruby programming language

UBC ARBERT and MARBERT Deep Bidirectional Transformers for Arabic

🏋️ dbbench is a simple database benchmarking tool which supports several databases and own scripts

ColdRec: An Open-Source Toolbox for Cold-Start Recommendation.

The world's #1 vibe coding benchmark — models go head-to-head on real engineering tasks, judged blind, ranked by Elo.

Awsome-Multi-modal-based PHM （基于多模态的故障诊断和预测）

Sample benchmark files for Hyperledger Caliper https://wiki.hyperledger.org/display/caliper

Simple HTTP benchmark for different nodejs frameworks using wrk

measure startup time of your react-native app

A manually vetted dataset for security vulnerability detection in Java projects

Agentic RL 中文零基础教程（33 章）：从概念到 GRPO 实战，含 TRL 最小可跑示例；26–33 章附一套可运行的三方判别模型实证工程（encoder vs LLM-LoRA vs 规则基...

Benchmark CS:GO on any map

Benchmarks for bundlers and build tools, including Rspack, Rsbuild, webpack, Vite, Rolldown, esbuild, Parcel, Farm and Utoo.

[ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".

Challenging Memory-based Deep Reinforcement Learning Agents

Ultra-Fast Python Solutions: 110x Speed Optimization Guide 2026

A tool for benchmarking the render performance of React components

[NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge

This is an open-source tool to assess and improve the trustworthiness of AI systems.

A benchmark for evaluating LLM × harness performance.

The ORBIT dataset is a collection of videos of objects in clean and cluttered scenes recorded by people who are blind/low-vision on a mobile phone. Th...

A GPU benchmark suite for assessing on-chip GPU memory bandwidth

Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models

[ICML 2023] Change is Hard: A Closer Look at Subpopulation Shift