SWE-bench

benchmark

SWE-bench [Multimodal]: Can Language Models Resolve Real-world Github Issues?

How to download and setup SWE-bench

Open terminal and run command

git clone https://github.com/SWE-bench/SWE-bench.git

git clone is used to create a copy or clone of SWE-bench repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with SWE-bench https://github.com/SWE-bench/SWE-bench/archive/master.zip

Or simply clone SWE-bench with SSH

[email protected]:SWE-bench/SWE-bench.git

If you have some problems with SWE-bench

You may open issue on SWE-bench support forum (system) here: https://github.com/SWE-bench/SWE-bench/issues

Similar to SWE-bench repositories

Here you may see SWE-bench alternatives and analogs

netdata primesieve fashion-mnist FrameworkBenchmarks BenchmarkDotNet jmeter awesome-semantic-segmentation sysbench hyperfine tsung benchmark_results across web-frameworks php-framework-benchmark jsperf.com go-web-framework-benchmark huststore phoronix-test-suite Attabench ann-benchmarks sbt-jmh caffenet-benchmark chillout IocPerformance prophiler TBCF NBench sympact awesome-http-benchmark BlurTestAndroid