benchmark

Benchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words

An automated scoring function to facilitate and standardize the evaluation of goal-directed generative models for de novo molecular design

Server Info & Check Kit

Python timeit CLI for the 21st century! colored output, multi-line input with syntax highlighting and autocompletion and much more!

A lightweight harness designed to be simple to use, efficient, universially compatible with any coding agent to evaluate them over a broad set of codi...

[KDD2026] The repo contains the code for "FORGE: Forming Semantic Identifiers for Generative Retrieval in Industrial Datasets"

nablaDFT: Large-Scale Conformational Energy and Hamiltonian Prediction benchmark and dataset

Lossless AI compression: 33% less GPU memory, bit for bit.

Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.

The code release of paper "Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Method", AAAI 2023

Awesome Mojo🔥

An Alibaba open-source multi-language benchmark for evaluating LLMs in repository-level automatic code review, featuring an AI-assisted and expert-ver...

C++ Binary Fixed-Point Arithmetic

A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.

HAKE: Human Activity Knowledge Engine (CVPR'18/19/20, NeurIPS'20, TPAMI'21)

Benchmark your Kubernetes storage.

A benchmark that challenges language models to code solutions for scientific problems

[FSE'26, WWW'25, ASE'24] RCAEval: A Benchmark for Root Cause Analysis.

Comparative Evaluation of Hand-Crafted and Learned Local Features

Python & Matlab code for local feature descriptor evaluation with the HPatches dataset.

[ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents

A rapid http(s) benchmark tool written in Go

This repository is the official implementation of the paper Convolutional Neural Operators for robust and accurate learning of PDEs

[NeurIPS 2025 D&B🔥] OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generation

📊 zig benchmark

Performance benchmarks for Kubernetes

A universal load testing framework for Rust, with real-time tui support.

OpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful envi...

Performance of various open source GBM implementations

Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.

The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai

This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selec...

Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)

GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents

DBNet: A Large-Scale Dataset for Driving Behavior Learning, CVPR 2018

An End-to-End Benchmark Suite for Univariate Time-Series Anomaly Detection

Memory-Dependent Manipulation Benchmark based on RoboTwin

Matbench: Benchmarks for materials science property prediction

TPC-H benchmark kit with some modifications/additions

Automated CIS Benchmark Compliance Remediation for RHEL 9 with Ansible

HTTP load testing for CI/CD — honest latency, CI thresholds, single binary, JSON output

Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296

RAID is the largest and most challenging benchmark for AI-generated text detection. (ACL 2024)

The globalping probe code that runs on your hardware and connects to the global community network of probes

[ICLR 2025] BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining A...

A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.

[NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

AI 大模型世界，把 556 个大模型拟人化成像素小人的可视化站点。进来就能看到此刻谁最聪明、谁最会写代码、谁最便宜、谁刚发布，往下是国内与国外分区的厂商广场...