Search results

Move format_report.py into evaluation repo

Status: Open.

#205 In OpenHands/benchmarks;

· simonrosenberg opened on Dec 24, 2025

SWT bench eval: Command '/bin/bash /eval.sh' timed out after 1800 seconds

Status: Open.

#202 In OpenHands/benchmarks;

· juanmichelini opened on Dec 23, 2025

Multimodal: add support test split

Status: Open.

#201 In OpenHands/benchmarks;

· juanmichelini opened on Dec 23, 2025

ALL: enrich output.jsonl from output.report.jsonl

Status: Open.

#195 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

Multimodal: create output.report.json

Status: Open.

#194 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

GAIA: create output.report.json

Status: Open.

#191 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

SWT-Bench: Standardize evaluation helpers and file layout

Status: Open.

#188 In OpenHands/benchmarks;

· juanmichelini opened on Dec 22, 2025

feat: Add SWE-bench Pro support

Status: Open.

#184 In OpenHands/benchmarks;

· tonylek opened on Dec 22, 2025

Standardize evaluation helpers and file layout

Status: Open.

#177 In OpenHands/benchmarks;

· simonrosenberg opened on Dec 18, 2025

feat: respect registry rate limits

Status: Open.

#172 In OpenHands/benchmarks;

· juanmichelini opened on Dec 17, 2025

refactor: GAIA should use same retry and max attempts logic as swebench.

Status: Open.

#171 In OpenHands/benchmarks;

· juanmichelini opened on Dec 17, 2025

CONTRIBUTE.md

Status: Open.

#168 In OpenHands/benchmarks;

· juanmichelini opened on Dec 16, 2025