Most popular benchmark repositories and open source projects

Awesome_Satellite_Benchmark_Datasets

Supplementary material for our paper "THERE IS NO DATA LIKE MORE DATA"...

28   354   354  

ros2-performance

Framework to evaluate peformance of ROS 2

70   351   351  

devtools

Inspect and Debug your Tauri applications in style 💃

11   351   351  

gapbs

GAP Benchmark Suite

150   351   351  

TurboBench

Compression Benchmark

36   350   350  

ronin

RoNIN: Robust Neural Inertial Navigation in the Wild

116   349   349  

gym-electric-motor

Gym Electric Motor (GEM): An OpenAI Gym Environment for Electric Motor...

73   349   349  

model-vs-human

Benchmark your model on out-of-distribution datasets with carefully co...

54   349   349  

LawBench

Benchmarking Legal Knowledge of Large Language Models

58   347   347  

AgentLab

AgentLab: An open-source framework for developing, testing, and benchm...

69   347   347  

png2svg

:twisted_rightwards_arrows: Convert small PNG images to SVG Tiny 1.2

40   343   343  

BabelStream

STREAM, for lots of devices written in many programming models

119   340   340  

pglib-opf

Benchmarks for the Optimal Power Flow Problem

90   339   339  

recsys-dataset

🛍 A real-world e-commerce dataset for session-based recommender system...

49   337   337  

tpcds-kit

TPC-DS benchmark kit with some modifications/fixes

220   335   335  

fperf

Framework of performance testing

39   334   334  

go-orm-benchmarks

Advanced benchmarks for +15 Go ORMs.

35   332   332  

InfiniteBench

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond...

28   329   329  

ptg

💥Performance testing tool (Go), It is also a GUI gRPC client.

36   328   328  

go-benchmark

Golang benchmarks used for optimizing code

17   327   327  

SciMLBenchmarks.jl

Scientific machine learning (SciML) benchmarks, AI for science, and (d...

94   327   327  

monorepo.tools

Your defacto guide on monorepos, and in depth feature comparisons of t...

33   326   326  

Awesome_Imputation

Awesome Deep Learning for Time-Series Imputation, including an unmissa...

37   326   326  

join-order-benchmark

Join Order Benchmark (JOB)

92   324   324  

openvqa

A lightweight, scalable, and general framework for visual question ans...

63   323   323  

regex-benchmark

It's just a simple regex benchmark of different programming languages.

56   321   321  

vector-db-benchmark

Framework for benchmarking vector search engines

107   321   321  

sysbench-tpcc

Sysbench scripts to generate a tpcc-like workload for MySQL and Postgr...

111   317   317  

jmh-visualizer

Visually explore your JMH Benchmarks

26   315   315  

Craftax

(Crafter + NetHack) in JAX. ICML 2024 Spotlight.

31   315   315  

ProteinGym

Official repository for the ProteinGym benchmarks

40   315   315  

LanczosNetwork

Lanczos Network, Graph Neural Networks, Deep Graph Convolutional Netwo...

65   314   314  

superbenchmark

A validation and profiling tool for AI infrastructure

68   314   314  

bench

A generic latency benchmarking library.

24   312   312  

api-benchmark

A node.js tool to benchmark APIs

34   311   311  

magma

A ground-truth fuzzing benchmark suite based on real programs with rea...

98   310   310  

map_benchmark

Comprehensive benchmarks of C++ maps

29   309   309  

CRUD_RAG

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Ge...

23   309   309  

Turbo-Base64

Turbo Base64 - Fastest Base64 SIMD:SSE/AVX2/AVX512/Neon/Altivec - Fast...

44   307   307  

Awesome-Evaluation-of-Visual-Generation

A list of works on evaluation of visual generation models, including e...

17   306   306  

optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm...

58   302   302  

Youku-mPLUG

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-train...

11   300   300  

bark

Open-Source Framework for Development, Simulation and Benchmarking of...

72   300   300  

BLUE_Benchmark

BLUE benchmark consists of five different biomedicine text-mining task...

41   296   296  

RHEL8-CIS

Automated CIS Benchmark Compliance Remediation for RHEL 8 with Ansible

175   293   293  

Face-Renovation

Official repository of the paper "HiFaceGAN: Face Renovation via Colla...

49   290   290  

dbtester

Distributed database benchmark tester

48   289   289  

CARLA

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterf...

63   289   289  

elimination_game

A multi-player tournament benchmark that tests LLMs in social reasonin...

10   289   289  

CBGBench

Official code repository of < CBGBench: Fill in the Blank of Protein-M...

34   289   289