Per-test performance deltas against the base model. Green +X.XX = scored X.XX higher than the base on that test; red = lower; "=" = identical score. Click a model name for its full answers.
| Model | ceo slack compression | funnel digest paragraph | partner digest section | rfp answer from policy | stalled deal followup | churn save eligibility | expansion kit | onboarding status | renewal risk conflicting dates | ticket theme synthesis | crm completeness enrichment | gong hubspot join integrity | owner resolution | snowflake sql trapped catalog | stage hygiene audit | call transcript extraction | closed lost classification | next to close | pipeline tiering | product gap detection | case study match | channel attribution math | competitor battlecard update | nurture sequence diagnosis | weekly marketing goals rollup | datadog incident timeline | feature flag state summary | nda triage | runbook from slack thread | skill file reconciliation | activity mix vs outcome | ae qtd scorecard | multithreading gap | stale pipeline by rep | talk track from transcripts | aha moment 2x2 | arr rollforward reconciliation | kvm month over month | q3 weighted forecast | rewards ytd section |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| meta/muse-wonder | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | +0.40 | = | = | +0.50 |
| elorian/glimpse | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| deepseek/deepseek-pro-latest | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| inclusionai/ling-3.1-flash | = | = | = | = | = | = | = | = | โ | โ | = | โ | โ | = | โ | = | โ | = | โ | = | = | โ | = | โ | = | = | = | = | +0.25 | โ | โ | โ | = | โ | = | โ | โ | = | โ | โ |
| xiaomi/mimo-v2.6-pro | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | โ | = | โ | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| fireworks/ember-1 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | = | +0.50 |
| meta/muse-spark-1.1 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | = | +0.40 | -0.20 | = | +0.50 |
| moonshotai/kimi-k3 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | +0.40 | = | = | +0.50 |
| z-ai/glm-5.3-flashx | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | = | +0.40 | = | = | +0.17 |
| z-ai/glm-5v-turbo | -0.20 | = | = | = | = | = | = | -0.25 | = | = | = | โ | = | = | = | = | +0.40 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | โ | = | = | = | โ | +0.20 | = | = | โ |
| unbiased/pareto-26.9 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| scaledown/summarize | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.17 | = | +0.40 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | +0.40 | = | = | +0.50 |
| stepfun/step-5-preview | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.17 | +0.40 | = | -0.20 | +0.50 |
| qwen/qwen3.8-max-0902 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | = | = | = | +0.50 |
| google/gemini-3.8-flash | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | = | +0.50 |
| meta/muse-spark-1.3 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.17 | -0.20 | = | +0.40 | = | = | +0.50 |
| xiaomi/mimo-v2.5-pro | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.30 | +0.50 |
| meta/muse-spark-open | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.17 | -0.33 | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | -0.20 | = | +0.50 |
| tencent/hy3-preview | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | -0.17 | +0.40 | = | = | +0.50 |
| anthropic/claude-opus-5 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | -0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | = | +0.50 |
| z-ai/glm-5.3-prime | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | โ | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | โ | = | = | โ | = | -0.17 | +0.40 | = | = | +0.50 |
| qwen/qwen3.8-flash | = | = | = | = | -0.33 | = | = | = | = | = | = | = | = | = | = | = | +0.40 | +0.25 | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.20 | = | = | +0.50 |
| unbiased/pareto | -0.40 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| meta/muse-spark-1.2 | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.40 | +0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | -0.20 | = | +0.50 |
| z-ai/glm-5.1 | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.20 | = | -0.10 | +0.50 |
| z-ai/glm-5-turbo | = | = | = | = | = | = | = | = | = | = | = | โ | โ | = | โ | = | +0.20 | +0.25 | โ | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | โ | โ | = | โ | = | โ | = | = | = | โ |
| aion-labs/aion-3.5 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | โ | = | โ | = | = | = | -0.25 | = | = | โ | = | = | = | = | +0.25 | +0.14 | โ | โ | = | โ | = | -0.17 | +0.40 | = | = | โ |
| z-ai/glm-5.3-flash | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | = | +0.17 |
| qwen/qwen3.8-omni-flash | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.20 | = | = | +0.50 |
| z-ai/glm-5.3 | -0.20 | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.10 | +0.50 |
| unbiased/pareto-26.10 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.17 |
| xiaomi/mimo-v2.6-flash | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | -0.50 | โ | = | โ | = | โ | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | โ | = | = | +0.40 | = | = | +0.50 |
| tencent/hy3 | = | = | = | = | = | = | = | = | = | = | = | -0.25 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| anthropic/claude-opus-4.5 | = | = | = | = | = | = | = | -0.25 | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | +0.25 | -0.20 | = | = | -0.20 | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | = | +0.50 |
| ~unbiased/pareto-latest | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | = | +0.17 |
| openai/gpt-5.5-pro | = | = | = | = | = | = | = | = | = | = | -0.20 | +0.25 | = | = | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| deepseek/deepseek-flash-latest | -0.20 | = | -0.33 | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | +0.25 | = | = | -0.25 | = | = | = | = | = | = | -0.33 | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | -0.10 | +0.50 |
| qwen/qwen3.8-2.4t-a95b | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | -0.20 | = | -0.25 | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.33 | +0.40 | = | = | +0.50 |
| google/gemini-4-argon | -0.20 | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | -0.33 | = | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | -0.10 | +0.50 |
| anthropic/claude-sonnet-5.5 | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.33 | = | -0.17 | +0.20 | = | = | +0.50 |
| xiaomi/mimo-v2.6-pro-ultraspeed | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.20 | = | = | +0.50 |
| deepseek/deepseek-v4-pro | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | = | = | -0.33 | +0.20 | = | -0.20 | +0.50 |
| anthropic/claude-opus-5.5 | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| google/gemini-3.7-flash | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.10 | +0.50 |
| qwen/qwen3.8-27b | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.33 | +0.20 | = | = | +0.50 |
| xingchen-agi/xing4.0-29b-a4b:free | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.17 | -0.33 | = | +0.40 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| sakana/fugu-ultra | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.33 | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | -0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| qwen/qwen3.8-max-prime | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.40 | = | = | = | -0.25 | = | = | = | = | = | = | = | = | +0.14 | = | = | = | = | = | -0.33 | +0.20 | = | = | +0.50 |
| meituan/longcat-2.0 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | = | = | -0.17 | = | = | -0.10 | +0.50 |
| anthropic/claude-opus-4.7 | = | = | = | = | = | = | = | = | = | -0.20 | = | +0.25 | -0.17 | = | -0.17 | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.20 | -0.20 | = | +0.50 |
| openai/gpt-5.5 | = | = | = | = | = | = | = | = | = | = | -0.20 | +0.25 | -0.17 | -0.33 | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-5.2-pro | = | = | -0.33 | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | +0.40 | -0.20 | = | +0.33 |
| openai/gpt-6-astra | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| deepseek/deepseek-v4.1-flash-1017 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | = | = | -0.50 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | = | = | = | +0.40 | = | = | +0.17 |
| openai/gpt-6.1-sol-pro | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| anthropic/claude-opus-4.8 | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.33 | +0.20 | = | -0.10 | +0.50 |
| scaledown/extract | -0.20 | = | = | = | = | = | = | = | -0.25 | = | = | +0.25 | = | -0.33 | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.20 | = | = | +0.50 |
| minimax/minimax-m3.1-flash:free | = | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | +0.40 | = | = | = | -0.25 | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | -0.20 | = | +0.50 |
| openai/gpt-5.2 | -0.20 | = | -0.33 | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | = | +0.40 | = | = | +0.33 |
| moonshotai/kimi-k2.7-code | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.17 | = | -0.20 | -0.10 | +0.50 |
| deepseek/deepseek-v4-flash-0731 | = | = | = | = | -0.33 | = | = | = | = | = | = | = | = | = | = | = | +0.20 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.17 | +0.40 | = | -0.30 | +0.50 |
| deepseek/deepseek-v4-pro-0813 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | -0.50 | = | = | +0.40 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| xiaomi/mimo-v2.5 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.20 | = | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | = | = | = | = |
| nvidia/nemotron-3.5-super-vl:free | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.50 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| typesafe/jev-router | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.40 | = | -0.80 | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | -0.10 | +0.50 |
| poolside/laguna-s-2.1 | = | -0.67 | = | = | = | = | = | = | = | -0.20 | = | +0.25 | = | -0.33 | = | = | โ | +0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | = | = | = | +0.50 |
| stealth/space-bunny-alpha | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.17 | -0.33 | = | = | โ | = | โ | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.20 | = | -0.10 | +0.50 |
| openai/gpt-5.4-pro | = | = | -0.33 | = | = | = | = | = | = | = | = | +0.25 | -0.33 | = | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-6-astra-pro | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-6-sol | -0.20 | = | = | = | = | = | = | = | -0.25 | = | = | +0.25 | = | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | -0.20 | = | = | +0.25 | = | = | = | -0.25 | -0.17 | = | -0.17 | +0.40 | = | = | +0.50 |
| nex-agi/nex-n2-mini | = | = | = | = | = | = | = | = | = | = | โ | โ | -0.67 | -0.33 | -0.17 | = | โ | = | โ | = | = | = | โ | โ | = | = | = | = | +0.25 | โ | โ | = | โ | โ | = | โ | โ | = | -0.10 | +0.50 |
| anthropic/claude-sonnet-5 (BASE) | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.75 | 1.00 | 1.00 | 1.00 | 1.00 | 0.60 | 0.75 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.75 | 0.86 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.60 | 1.00 | 1.00 | 0.50 |
| openai/gpt-5.6-sol | -0.20 | = | = | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | = | -0.17 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| openai/gpt-6.1-sol | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.75 | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| deepseek/deepseek-v4-flash | -0.40 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | -0.20 | +0.40 | +0.25 | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | = | = | -0.17 | = | = | = | = |
| nvidia/nemotron-3.5-super-vl | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.14 | = | = | -0.25 | -0.17 | = | = | = | -0.20 | -0.20 | +0.50 |
| anthropic/claude-haiku-4.5 | = | = | = | = | = | = | -0.17 | = | = | = | = | +0.25 | -0.17 | = | -0.17 | = | +0.40 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.25 | -0.33 | = | -0.33 | +0.20 | = | = | +0.50 |
| minimax/minimax-m2.1 | -0.40 | = | = | = | = | = | -0.17 | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | -0.17 | = | = | = | -0.17 | +0.20 | = | = | = |
| openai/gpt-5.6-sol-pro | -0.20 | = | = | = | = | = | = | -0.25 | = | = | = | +0.25 | = | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | = |
| openai/gpt-5.6-luna | = | = | = | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | -0.17 | -0.50 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| openai/gpt-5.4-mini | = | = | = | = | = | = | -0.17 | -0.25 | = | = | = | = | = | = | = | = | +0.20 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.50 | = | -0.17 | = | = | = | +0.50 |
| openai/gpt-5.1 | = | = | -0.33 | = | = | = | -0.17 | = | = | -0.20 | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.40 | +0.50 |
| openai/gpt-5.6-luna-pro | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.17 | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.20 | = | -0.25 | -0.33 | = | = | +0.40 | = | = | = |
| meta/muse-glimmer-30b | = | = | -0.33 | = | = | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | = | = | = | +0.40 | -0.20 | = | -0.50 |
| anthropic/claude-haiku-5.5 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.40 | = | -0.80 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | -0.17 | -0.25 | -0.33 | = | = | +0.40 | = | -0.10 | +0.50 |
| openai/gpt-5-pro | -0.20 | = | -0.33 | = | = | = | = | = | = | -0.20 | -0.20 | = | -0.33 | = | = | = | +0.40 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| mistralai/mistral-large-4-0 | -0.40 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | -0.17 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -1.00 | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| aion-labs/aion-3.5-mini | = | -0.67 | = | = | = | = | = | = | = | = | = | = | = | = | โ | = | = | = | โ | = | -0.25 | = | = | = | = | = | = | = | +0.25 | = | = | โ | = | = | = | -0.50 | +0.40 | = | = | โ |
| nex-agi/nex-n2-pro | โ | = | -0.33 | = | = | โ | = | = | โ | โ | โ | โ | โ | -0.17 | โ | โ | โ | = | โ | = | = | = | = | โ | โ | โ | = | โ | = | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ |
| stepfun/step-3.5-flash | = | = | = | = | = | -0.20 | = | = | -0.25 | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | -0.20 | = | = | = | +0.25 | = | = | = | -0.25 | -0.17 | = | -0.17 | +0.40 | = | -0.60 | = |
| openai/gpt-6-sol-pro | -0.20 | = | = | = | = | = | = | = | -0.25 | = | = | +0.25 | = | -0.50 | -0.17 | = | +0.20 | -0.25 | = | = | = | = | = | = | = | -0.40 | = | = | = | = | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| openai/gpt-5.4-nano | = | = | -0.33 | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | -0.17 | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | -0.25 | -0.67 | = | -0.17 | +0.20 | -0.20 | -0.10 | +0.33 |
| openai/gpt-5.6-terra | -0.20 | = | -0.33 | = | = | -0.40 | = | = | = | = | -0.20 | +0.25 | -0.33 | -0.33 | = | = | +0.20 | = | -0.20 | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | -0.20 | = | = | -0.17 | = | = | +0.40 | = | = | +0.50 |
| inclusionai/ling-3.0-flash | = | -0.33 | -0.33 | = | = | -0.20 | -0.17 | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | -0.60 | = | = | -0.20 | = | = | +0.25 | = | = | = | = | = | = | = | = | -0.20 | = | +0.50 |
| stepfun/step-3.7-flash | = | = | -0.33 | = | = | = | = | -0.25 | = | = | = | -0.50 | -0.17 | = | = | = | +0.20 | +0.25 | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | = | = | -0.17 | = | = | = | -0.17 | = | -0.20 | = | +0.50 |
| minimax/minimax-m2.5 | -0.20 | = | = | = | = | -0.40 | -0.17 | = | -0.25 | = | = | = | -0.17 | -0.33 | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.20 | = | = | = |
| openai/gpt-5 | -0.20 | = | -0.33 | = | = | = | = | = | = | = | -0.20 | = | -0.33 | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | -0.40 | = |
| thinkingmachines/inkling | = | = | = | = | -0.33 | = | = | = | -0.25 | = | = | -0.25 | -0.33 | = | = | -0.20 | +0.40 | = | -0.20 | = | = | -0.20 | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | = | = | -0.20 | = | +0.50 |
| openai/gpt-5.6-terra-pro | -0.20 | = | -0.33 | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | -0.17 | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | = | +0.40 | = | -0.10 | = |
| minimax/minimax-m2 | -0.40 | = | = | = | = | = | = | = | = | = | = | -0.25 | = | -0.17 | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | -0.17 | +0.20 | = | -0.70 | +0.50 |
| upstage/solar-pro4 | -0.20 | = | = | = | = | = | -0.17 | = | = | = | = | +0.25 | = | = | -0.33 | = | +0.20 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | -1.00 | = | = | +0.20 | = | -0.30 | = |
| ibm-granite/granite-4.2-8b | -0.20 | = | -0.33 | = | = | = | -0.17 | = | = | -0.20 | -0.20 | = | = | = | = | = | โ | = | = | = | = | = | = | -0.25 | -0.20 | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.20 | -0.20 | -0.50 | +0.50 |
| reflection/beam-1.0-501b-a23b | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.50 | -0.50 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | -0.40 | = | -0.25 | -0.83 | = | = | +0.20 | -0.20 | -0.10 | +0.50 |
| tencent/hy4-preview | = | = | = | = | -0.67 | = | = | = | = | = | -1.00 | = | = | -0.17 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.50 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-6-luna | = | = | = | = | = | = | = | = | -0.25 | = | = | +0.25 | -0.17 | -0.17 | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | -0.20 | = | = | = | -0.14 | -0.80 | = | -0.25 | -0.33 | = | -0.50 | +0.40 | = | = | +0.50 |
| openai/gpt-5-mini | = | = | -0.33 | = | = | = | = | = | = | = | = | -0.50 | = | = | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | -0.20 | = | = | -0.67 | = | = | = | -0.20 | = | -0.17 |
| openai/gpt-chat-latest | = | = | = | = | = | = | = | = | = | -0.20 | -0.20 | +0.25 | = | -0.50 | -0.17 | = | +0.20 | = | -0.40 | = | = | = | = | = | = | = | = | = | = | +0.14 | -0.20 | = | -0.75 | -0.33 | = | = | +0.40 | = | -0.10 | = |
| google/gemma-4-31b-it | = | = | -0.33 | = | = | = | = | = | -0.25 | = | -0.20 | -0.25 | -0.67 | = | = | = | +0.40 | = | -0.20 | = | = | = | -0.20 | = | = | = | = | = | = | +0.14 | -0.20 | = | -0.25 | -0.17 | = | = | = | = | -0.20 | +0.50 |
| liquid/lfm-2.5-24b-a2b | = | = | -0.33 | = | = | -0.40 | = | = | โ | -0.20 | โ | = | -0.50 | = | -0.17 | = | +0.40 | = | = | = | = | = | โ | = | = | = | = | = | +0.25 | โ | = | โ | -0.25 | -0.17 | = | = | โ | = | -0.90 | = |
| openai/gpt-6-luna-pro | = | = | = | = | = | = | = | = | -0.25 | = | = | +0.25 | -0.17 | -0.50 | -0.33 | = | +0.20 | = | -0.60 | = | = | = | = | = | = | -0.20 | = | = | +0.25 | = | -0.80 | = | -0.25 | -0.33 | = | -0.33 | +0.40 | = | = | = |
| google/gemini-3-pro-image | -0.20 | = | -0.33 | = | = | -0.20 | = | = | = | = | -0.20 | +0.25 | = | = | = | = | = | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.33 | = | -0.83 | -0.60 | = | -0.40 | = |
| google/gemma-4-26b-a4b-it | = | = | -0.33 | = | = | -0.20 | = | = | -0.25 | = | -0.20 | -0.75 | -0.67 | = | = | = | +0.20 | = | -0.20 | -0.50 | = | = | -0.20 | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | = | +0.20 | -0.20 | -0.10 | = |
| openai/gpt-5-nano | = | = | -0.33 | = | = | -0.20 | -0.17 | = | = | -0.40 | = | -0.75 | -0.50 | = | -0.33 | = | +0.40 | = | -0.20 | -0.50 | -0.25 | = | -0.40 | = | -0.20 | = | = | -0.33 | +0.25 | +0.14 | = | -0.17 | -0.25 | -0.17 | -0.20 | -0.67 | = | -0.40 | -0.60 | = |
| openai/o4-mini | -0.20 | = | -0.33 | = | = | -0.20 | -0.17 | = | -0.25 | -0.40 | = | -0.50 | -0.50 | = | -0.17 | = | +0.20 | +0.25 | -0.20 | -0.50 | = | = | -0.20 | -0.25 | -0.20 | = | = | = | = | +0.14 | = | -0.67 | = | -0.67 | = | -1.00 | -0.40 | -0.20 | -0.50 | = |
| openai/o3 | -0.20 | = | -0.33 | = | = | -0.40 | = | -0.25 | -0.25 | -0.20 | = | -0.75 | -0.83 | = | -1.00 | = | +0.20 | -0.25 | -0.80 | = | = | = | = | -0.25 | = | -0.20 | = | = | = | +0.14 | -0.80 | -0.50 | = | -0.67 | -0.20 | -0.17 | -0.40 | = | -0.40 | -0.50 |
| amazon/nova-premier-v1 | -0.20 | = | -1.00 | = | = | -0.80 | = | -0.25 | = | -0.40 | = | -0.75 | -0.33 | = | -0.83 | = | = | -0.25 | -0.20 | = | -0.75 | = | -0.20 | -0.25 | = | = | = | = | = | -0.29 | -0.20 | -0.50 | -0.25 | -0.67 | = | -0.83 | -0.40 | = | -0.70 | = |
| amazon/nova-pro-v1 | = | = | -1.00 | = | = | -0.40 | -0.83 | -0.75 | -0.75 | -0.80 | -0.20 | -0.50 | -0.67 | -0.50 | -0.33 | -0.20 | +0.20 | -0.50 | -0.20 | -0.75 | -0.25 | -0.20 | -0.20 | = | -0.20 | = | = | = | -0.25 | +0.14 | -0.40 | -0.50 | -0.25 | -0.83 | -0.20 | -0.67 | +0.20 | -0.60 | -0.70 | = |