← RevenueBench home
RevenueBench · Response Review Viewer v3

Every Model's Actual Answers — Prompt · Correct Answer · Model Answer

119 curated models × 40 GTM tests. Each test card shows the prompt sent, the correct answer (gold), and the model's full unedited answer — with per-check grading and telemetry. Every model row carries its input/output modalities.

📖 How to review: click any model name or the green view answers → button. On each model page, every test card shows three things: the prompt (top), the correct answer (gold panel, left) and the model's actual answer (white panel, right — click to expand). Each card opens with a one-line plain-English answer, then every field in rows. Category sections collapse: click a category to open or hide its tests. Models still completing the suite are shown in yellow-striped rows with their current partial score and test count.
⚖️ How grading works (explicitly): every response is graded by deterministic Python code (scorers.py) against frozen ground-truth files (truth_new.json / truth_canonical.json) that were computed programmatically from the same CSV data the models saw. NO LLM grades any response — no judge model, no AI evaluation, ever. Three check layers: (1) numeric presence within tolerance bands (e.g. ±5% for ratios, ±1–5% for money), (2) regex/phrase presence for required findings, (3) an entity whitelist that flags any deal/company alias not in the source data (fabrication detection). Every check shown as ✓/✗ chips is one of these deterministic checks. The identical code and identical truth files grade all 119 models — byte-for-byte the same standard. The full methodology is in the test specification.
#ModelMeanPerfectCost
1deepseek/deepseek-pro-latest
text in: text · out: text
view answers →
0.98537/40$0.99
2xiaomi/mimo-v2.6-pro
textimagevideoaudio in: text, image, video, audio · out: text
view answers →
0.984 · 38/40 final35/38$0.62
3fireworks/ember-1
textimage in: text, image · out: text
view answers →
0.98036/40$7.31
4z-ai/glm-5.3-flashx
textimagevideo in: text, image, video · out: text
view answers →
0.97836/40$1.34
5meta/muse-spark-1.1
textimagefilevideoaudio in: text, image, file, video, audio · out: text
view answers →
0.97735/40$2.17
6moonshotai/kimi-k3
textimagevideo in: text, image, video · out: text
view answers →
0.97636/40$7.67
7xiaomi/mimo-v2.5-pro
text in: text · out: text
view answers →
0.97436/40$0.69
8meta/muse-spark-1.3
textimagefilevideoaudio in: text, image, file, video, audio · out: text
view answers →
0.97335/40$3.03
9unbiased/pareto
textimage in: text, image · out: text
view answers →
0.97336/40$9.11
10google/gemini-3.8-flash
textimagefilevideoaudio in: text, image, file, video, audio · out: text
view answers →
0.97034/40$6.34
11qwen/qwen3.8-flash
textimagevideo in: text, image, video · out: text
view answers →
0.96935/40$0.34
12z-ai/glm-5.3-flash
textimagevideo in: text, image, video · out: text
view answers →
0.96835/40$0.28
13z-ai/glm-5.1
text in: text · out: text
view answers →
0.96833/40$1.99
14tencent/hy3-preview
text in: text · out: text
view answers →
0.96834/40$0.59
15z-ai/glm-5v-turbo
textimagevideo in: text, image, video · out: text
view answers →
0.967 · 36/40 final31/36$1.81
16anthropic/claude-opus-5
textimagefile in: text, image, file · out: text
view answers →
0.96735/40$15.91
17tencent/hy3
text in: text · out: text
view answers →
0.96736/40$0.33
18qwen/qwen3.8-max-0902
textimagevideo in: text, image, video · out: text
view answers →
0.96635/40$3.88
19aion-labs/aion-3.5
text in: text · out: text
view answers →
0.966 · 33/40 final28/33$3.06
20z-ai/glm-5-turbo
text in: text · out: text
view answers →
0.966 · 31/40 final27/31$1.21
21z-ai/glm-5.3-prime
text in: text · out: text
view answers →
0.966 · 37/40 final31/37$11.37
22meta/muse-spark-1.2
textimagefilevideoaudio in: text, image, file, video, audio · out: text
view answers →
0.96433/40$3.60
23xiaomi/mimo-v2.6-flash
textimagevideoaudio in: text, image, video, audio · out: text
view answers →
0.962 · 36/40 final31/36$0.26
24qwen/qwen3.8-omni-flash
textimagevideoaudio in: text, image, video, audio · out: text
view answers →
0.96233/40$0.63
25openai/gpt-5.5-pro
textimagefile in: text, image, file · out: text
view answers →
0.96133/40$123.62
26z-ai/glm-5.3
text in: text · out: text
view answers →
0.96033/40$6.86
27deepseek/deepseek-v4-pro
text in: text · out: text
view answers →
0.95933/40$1.04
28anthropic/claude-opus-5.5
textimagefile in: text, image, file · out: text
view answers →
0.95833/40$8.01
29google/gemini-3.7-flash
textimagefilevideoaudio in: text, image, file, video, audio · out: text
view answers →
0.95731/40$5.14
30anthropic/claude-opus-4.5
textimagefile in: text, image, file · out: text
view answers →
0.95732/40$9.83
31sakana/fugu-ultra
textimage in: text, image · out: text
view answers →
0.95734/40$31.55
32deepseek/deepseek-flash-latest
textimage in: text, image · out: text
view answers →
0.95632/40$0.96
33meituan/longcat-2.0
text in: text · out: text
view answers →
0.95532/40$0.63
34moonshotai/kimi-k2.7-code
textimage in: text, image · out: text
view answers →
0.95331/40$1.57
35qwen/qwen3.8-27b
textimagevideo in: text, image, video · out: text
view answers →
0.95332/40$1.63
36qwen/qwen3.8-max-prime
textimagevideo in: text, image, video · out: text
view answers →
0.95332/40$9.09
37openai/gpt-5.2-pro
textimagefile in: text, image, file · out: text
view answers →
0.95231/40$97.83
38openai/gpt-6-astra
textimagefile in: text, image, file · out: text
view answers →
0.95234/40$19.82
39xiaomi/mimo-v2.6-pro-ultraspeed
textimagevideoaudio in: text, image, video, audio · out: text
view answers →
0.95133/40$7.04
40anthropic/claude-opus-4.7
textimagefile in: text, image, file · out: text
view answers →
0.95033/40$10.70
41qwen/qwen3.8-2.4t-a95b
text in: text · out: text
view answers →
0.94832/40$5.20
42deepseek/deepseek-v4-pro-0813
text in: text · out: text
view answers →
0.94732/40$1.85
43openai/gpt-5.5
textimagefile in: text, image, file · out: text
view answers →
0.94531/40$9.06
44openai/gpt-5.2
textimagefile in: text, image, file · out: text
view answers →
0.94429/40$7.35
45minimax/minimax-m2.1
text in: text · out: text
view answers →
0.94231/40$0.67
46stealth/space-bunny-alpha
textimagevideo in: text, image, video · out: text
view answers →
0.942 · 38/40 final28/38$0.00
47openai/gpt-5.4-pro
textimagefile in: text, image, file · out: text
view answers →
0.94232/40$131.87
48anthropic/claude-opus-4.8
textimagefile in: text, image, file · out: text
view answers →
0.94129/40$13.06
49openai/gpt-6-astra-pro
textimagefile in: text, image, file · out: text
view answers →
0.94132/40$43.54
50openai/gpt-6-sol
textimagefile in: text, image, file · out: text
view answers →
0.94129/40$7.59
51openai/gpt-5.6-sol
textimagefile in: text, image, file · out: text
view answers →
0.94029/40$3.67
52anthropic/claude-sonnet-5
textimagefile in: text, image, file · out: text
view answers →
0.94032/40$8.38
53anthropic/claude-haiku-4.5
textimagefile in: text, image, file · out: text
view answers →
0.94029/40$2.34
54deepseek/deepseek-v4-flash-0731
text in: text · out: text
view answers →
0.93930/40$0.09
55poolside/laguna-s-2.1
text in: text · out: text
view answers →
0.939 · 39/40 final33/39$0.27
56nex-agi/nex-n2-mini
text in: text · out: text
view answers →
0.939 · 28/40 final22/28$0.06
57openai/gpt-5.6-sol-pro
textimagefile in: text, image, file · out: text
view answers →
0.93731/40$7.97
58openai/gpt-5.6-luna
textimagefile in: text, image, file · out: text
view answers →
0.93630/40$0.42
59xiaomi/mimo-v2.5
textimagevideoaudio in: text, image, video, audio · out: text
view answers →
0.93631/40$0.27
60deepseek/deepseek-v4-flash
text in: text · out: text
view answers →
0.93630/40$0.20
61openai/gpt-5.4-mini
textimagefile in: text, image, file · out: text
view answers →
0.93530/40$3.21
62openai/gpt-5.1
textimagefile in: text, image, file · out: text
view answers →
0.93530/40$4.83
63openai/gpt-5.6-luna-pro
textimagefile in: text, image, file · out: text
view answers →
0.93429/40$1.04
64nex-agi/nex-n2-pro
text in: text · out: text
view answers →
0.929 · 14/40 final10/14$0.05
65stepfun/step-3.5-flash
text in: text · out: text
view answers →
0.92829/40$0.45
66openai/gpt-5-pro
textimagefile in: text, image, file · out: text
view answers →
0.92729/40$93.00
67aion-labs/aion-3.5-mini
text in: text · out: text
view answers →
0.926 · 36/40 final28/36$0.72
68meta/muse-glimmer-30b
textimage in: text, image · out: text
view answers →
0.92530/40$0.98
69openai/gpt-6-sol-pro
textimagefile in: text, image, file · out: text
view answers →
0.92129/40$15.93
70openai/gpt-5.4-nano
textimagefile in: text, image, file · out: text
view answers →
0.92026/40$1.04
71openai/gpt-5.6-terra
textimagefile in: text, image, file · out: text
view answers →
0.92027/40$3.67
72inclusionai/ling-3.0-flash
text in: text · out: text
view answers →
0.91928/40$0.06
73stepfun/step-3.7-flash
textimagevideo in: text, image, video · out: text
view answers →
0.91928/40$0.79
74minimax/minimax-m2.5
text in: text · out: text
view answers →
0.91927/40$0.44
75openai/gpt-5
textimagefile in: text, image, file · out: text
view answers →
0.91628/40$6.21
76thinkingmachines/inkling
textimageaudio in: text, image, audio · out: text
view answers →
0.91627/40$3.13
77openai/gpt-5.6-terra-pro
textimagefile in: text, image, file · out: text
view answers →
0.91526/40$7.98
78minimax/minimax-m2
text in: text · out: text
view answers →
0.91428/40$1.19
79ibm-granite/granite-4.2-8b
text in: text · out: text
view answers →
0.912 · 39/40 final24/39$0.36
80upstage/solar-pro4
text in: text · out: text
view answers →
0.90929/40$0.05
81tencent/hy4-preview
text in: text · out: text
view answers →
0.90629/40$1.73
82qwen/qwen3.7-flash
textimagevideo in: text, image, video · out: text
view answers →
0.90627/40$0.08
83openai/gpt-6-luna
textimagefile in: text, image, file · out: text
view answers →
0.90427/40$0.28
84aion-labs/aion-3.0
text in: text · out: text
view answers →
0.904 · 39/40 final32/39$3.54
85bytedance-seed/seed-2.0-mini
textimagevideo in: text, image, video · out: text
view answers →
0.90028/40$0.12
86openai/gpt-chat-latest
textimagefile in: text, image, file · out: text
view answers →
0.89927/40$3.77
87openai/gpt-5-mini
textimagefile in: text, image, file · out: text
view answers →
0.89630/40$1.04
88google/gemma-4-31b-it
textimagevideo in: text, image, video · out: text
view answers →
0.88924/40$0.16
89bytedance-seed/seed-1.6
textimagevideo in: text, image, video · out: text
view answers →
0.88026/40$0.71
90minimax/minimax-m3
textimagevideo in: text, image, video · out: text
view answers →
0.87826/40$0.62
91aion-labs/aion-3.0-mini
text in: text · out: text
view answers →
0.87428/40$1.29
92openai/gpt-6-luna-pro
textimagefile in: text, image, file · out: text
view answers →
0.87425/40$0.58
93arcee-ai/trinity-large-thinking
text in: text · out: text
view answers →
0.86926/40$0.68
94google/gemini-3-pro-image
textimageout:image in: text, image · out: text, image
view answers →
0.86826/40$3.80
95inception/mercury-2.5-preview
text in: text · out: text
view answers →
0.86726/40$0.10
96deepseek/deepseek-v3.2
text in: text · out: text
view answers →
0.86323/40$0.97
97cohere/command-a-plus
textimage in: text, image · out: text
view answers →
0.86324/40$3.06
98poolside/laguna-xs-2.1
text in: text · out: text
view answers →
0.85820/40$0.36
99aion-labs/aion-2.0
text in: text · out: text
view answers →
0.85326/40$0.76
100thinkingmachines/inkling-small
textimageaudio in: text, image, audio · out: text
view answers →
0.85123/40$0.89
101google/gemma-4-26b-a4b-it
textimagevideo in: text, image, video · out: text
view answers →
0.84920/40$0.11
102upstage/solar-mini4
text in: text · out: text
view answers →
0.81420/40$0.08
103mistralai/devstral-2512
textfile in: text, file · out: text
view answers →
0.79116/40$0.69
104openai/gpt-5-nano
textimagefile in: text, image, file · out: text
view answers →
0.79017/40$0.35
105inception/mercury-2
text in: text · out: text
view answers →
0.78919/40$0.82
106nvidia/nemotron-3.5-lightning
text in: text · out: text
view answers →
0.77615/40$0.32
107openai/o4-mini
textimagefile in: text, image, file · out: text
view answers →
0.77217/40$1.76
108mistralai/ministral-14b-2512
textimage in: text, image · out: text
view answers →
0.75519/40$0.43
109inclusionai/ling-3.0-flash-fin
text in: text · out: text
view answers →
0.74117/40$0.15
110mistralai/mistral-medium-3-5
textimagefile in: text, image, file · out: text
view answers →
0.73414/40$1.49
111mistralai/ministral-3b-2512
textimage in: text, image · out: text
view answers →
0.73215/40$0.22
112nvidia/nemotron-3-nano-30b-a3b
text in: text · out: text
view answers →
0.72815/40$0.73
113openai/o3
textimagefile in: text, image, file · out: text
view answers →
0.71517/40$4.13
114mistralai/mistral-small-2603
textimage in: text, image · out: text
view answers →
0.70710/40$0.13
115amazon/nova-premier-v1
textimage in: text, image · out: text
view answers →
0.69416/40$10.09
116meta-llama/llama-4-maverick
textimage in: text, image · out: text
view answers →
0.68914/40$0.24
117meta-llama/llama-3.3-70b-instruct
text in: text · out: text
view answers →
0.68316/40$0.05
118upstage/solar-pro-3
text in: text · out: text
view answers →
0.64513/40$0.69
119amazon/nova-pro-v1
textimage in: text, image · out: text
view answers →
0.6149/40$4.81