Search results

How to get logs(SWE-bench evaluation artifacts dump) when using sb-cli

Status: Open.

#22 In SWE-bench/sb-cli;

· sxthunder opened on Dec 3, 2025

Gold patches have 13 tasks failed in SWE-Bench-Verified

Status: Open.

#20 In SWE-bench/sb-cli;

· KawaiiNotHawaii opened on Nov 24, 2025

Evaluation of custom datasets with sb-cli

Status: Open.

#19 In SWE-bench/sb-cli;

· lorenzflow opened on Nov 11, 2025

Help with Swebench multimodal test set：the number of test data doesnt match with sb-cli

Status: Open.

#23 In SWE-bench/sb-cli;

· Leahxx opened on Nov 3, 2025

Help with Swebench multimodal test set：the number of test data doesnt match with sb-cli

Status: Open.

#18 In SWE-bench/sb-cli;

· Leahxx opened on Nov 2, 2025

New user, getting "429: Quota exceeded for swe-bench_verified/test. Please try again later or request increased quota."

Status: Open.

#16 In SWE-bench/sb-cli;

· dkashkin opened on Sep 14, 2025

Errors when submitting gold patches ( swe-bench verified )

Status: Open.

#15 In SWE-bench/sb-cli;

· 5taku opened on Aug 21, 2025

Which version of swebench is using by sb-cli?

Status: Open.

#14 In SWE-bench/sb-cli;

· daa233 opened on Aug 18, 2025

Support multilingual subset.

Status: Open.

#11 In SWE-bench/sb-cli;

· anhnh2002 opened on Jul 16, 2025

Quota Increase for swe bench verified

Status: Open.

#8 In SWE-bench/sb-cli;

· SonicSaurav opened on May 13, 2025