ignis · benchmark reports
Per-run HTML reports for ignis against agent benchmarks. Canonical history table: RESULTS.md. Cost columns use the prices in pricing. Click any row for the per-trial drill-in.
Comparisons
Date
Benchmark
Models
Δ score
2026-06-11
Terminal-Bench 2.1
glm-5.1 (Ark) · kimi-2.6 · deepseek-v4-flash@max · MiniMax-M3 · deepseek-v4-pro@max (Ark)
compare
›
Runs
2026-06-11
Terminal-Bench 2.1
ark-coding/deepseek-v4-pro@max
41/89 · 46.1%
$14.69$0.36 / pass
›
2026-06-09
Terminal-Bench 2.1
ark-coding/glm-5.1
57/89 · 64.0%
$33.15$0.58 / pass
›
2026-06-06
Terminal-Bench 2.1
kimi-code/kimi-2.6
53/89 · 59.6%
$28.19$0.53 / pass
›
2026-06-03
Terminal-Bench 2.1
deepseek/deepseek-v4-flash@max
50/89 · 56.2%
$2.28$0.05 / pass
›
2026-06-03
Terminal-Bench 2.1
minimax-token-plan/MiniMax-M3
46/89 · 51.7%
$9.39$0.20 / pass
›
2026-06-02
Terminal-Bench 2.1
minimax-token-plan/MiniMax-M3
42/89 · 47.2%
$5.65$0.13 / pass
›
2026-05-29
Terminal-Bench 2.0
deepseek/deepseek-v4-flash@max
54/89 · 60.7%
$1.34$0.02 / pass
›