Search results

swtbench.run_infer getting stuck?

Status: Open.

#315 In OpenHands/benchmarks;

· enochii opened on Jan 14, 2026

SWTBench profiling

Status: Open.

#314 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 14, 2026

Tool fall failures occurred during SWE-Bench testing based on DeepSeek-V3.2

Status: Open.

#312 In OpenHands/benchmarks;

· SefaZeng opened on Jan 14, 2026

SWT-bench: use mamba for env builds

Status: Open.

#306 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 13, 2026

Configure llm key for running benchmarks

openhands

Status: Open.

#301 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 12, 2026

Make Datadog conversation event logging opt-in

Status: Open.

#300 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 12, 2026

clarify retry semantics (max_attempts vs max_retries) in evaluation

Status: Open.

#295 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 12, 2026

Investigate GAIA null entries in output.jsonl

Status: Open.

#291 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 9, 2026

Apptainer for Swebench

Status: Open.

#283 In OpenHands/benchmarks;

· lilys012 opened on Jan 8, 2026

Run 50-image SWE-bench eval to debug runtime instability

Status: Open.

#282 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 8, 2026

Add Datadog metrics permissions to API key for runtime debugging

Status: Open.

#281 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 8, 2026

Refine runtime failure classification for resource backoff

Status: Open.

#277 In OpenHands/benchmarks;

· simonrosenberg opened on Jan 7, 2026