119 curated models × 40 GTM tests. Each test card shows the prompt sent, the correct answer (gold), and the model's full unedited answer — with per-check grading and telemetry. Every model row carries its input/output modalities.
| # | Model | Mean | Perfect | Cost |
|---|---|---|---|---|
| 1 | deepseek/deepseek-pro-latest text in: text · out: text view answers → | 0.985 | 37/40 | $0.99 |
| 2 | xiaomi/mimo-v2.6-pro textimagevideoaudio in: text, image, video, audio · out: text view answers → | 0.984 · 38/40 final | 35/38 | $0.62 |
| 3 | fireworks/ember-1 textimage in: text, image · out: text view answers → | 0.980 | 36/40 | $7.31 |
| 4 | z-ai/glm-5.3-flashx textimagevideo in: text, image, video · out: text view answers → | 0.978 | 36/40 | $1.34 |
| 5 | meta/muse-spark-1.1 textimagefilevideoaudio in: text, image, file, video, audio · out: text view answers → | 0.977 | 35/40 | $2.17 |
| 6 | moonshotai/kimi-k3 textimagevideo in: text, image, video · out: text view answers → | 0.976 | 36/40 | $7.67 |
| 7 | xiaomi/mimo-v2.5-pro text in: text · out: text view answers → | 0.974 | 36/40 | $0.69 |
| 8 | meta/muse-spark-1.3 textimagefilevideoaudio in: text, image, file, video, audio · out: text view answers → | 0.973 | 35/40 | $3.03 |
| 9 | unbiased/pareto textimage in: text, image · out: text view answers → | 0.973 | 36/40 | $9.11 |
| 10 | google/gemini-3.8-flash textimagefilevideoaudio in: text, image, file, video, audio · out: text view answers → | 0.970 | 34/40 | $6.34 |
| 11 | qwen/qwen3.8-flash textimagevideo in: text, image, video · out: text view answers → | 0.969 | 35/40 | $0.34 |
| 12 | z-ai/glm-5.3-flash textimagevideo in: text, image, video · out: text view answers → | 0.968 | 35/40 | $0.28 |
| 13 | z-ai/glm-5.1 text in: text · out: text view answers → | 0.968 | 33/40 | $1.99 |
| 14 | tencent/hy3-preview text in: text · out: text view answers → | 0.968 | 34/40 | $0.59 |
| 15 | z-ai/glm-5v-turbo textimagevideo in: text, image, video · out: text view answers → | 0.967 · 36/40 final | 31/36 | $1.81 |
| 16 | anthropic/claude-opus-5 textimagefile in: text, image, file · out: text view answers → | 0.967 | 35/40 | $15.91 |
| 17 | tencent/hy3 text in: text · out: text view answers → | 0.967 | 36/40 | $0.33 |
| 18 | qwen/qwen3.8-max-0902 textimagevideo in: text, image, video · out: text view answers → | 0.966 | 35/40 | $3.88 |
| 19 | aion-labs/aion-3.5 text in: text · out: text view answers → | 0.966 · 33/40 final | 28/33 | $3.06 |
| 20 | z-ai/glm-5-turbo text in: text · out: text view answers → | 0.966 · 31/40 final | 27/31 | $1.21 |
| 21 | z-ai/glm-5.3-prime text in: text · out: text view answers → | 0.966 · 37/40 final | 31/37 | $11.37 |
| 22 | meta/muse-spark-1.2 textimagefilevideoaudio in: text, image, file, video, audio · out: text view answers → | 0.964 | 33/40 | $3.60 |
| 23 | xiaomi/mimo-v2.6-flash textimagevideoaudio in: text, image, video, audio · out: text view answers → | 0.962 · 36/40 final | 31/36 | $0.26 |
| 24 | qwen/qwen3.8-omni-flash textimagevideoaudio in: text, image, video, audio · out: text view answers → | 0.962 | 33/40 | $0.63 |
| 25 | openai/gpt-5.5-pro textimagefile in: text, image, file · out: text view answers → | 0.961 | 33/40 | $123.62 |
| 26 | z-ai/glm-5.3 text in: text · out: text view answers → | 0.960 | 33/40 | $6.86 |
| 27 | deepseek/deepseek-v4-pro text in: text · out: text view answers → | 0.959 | 33/40 | $1.04 |
| 28 | anthropic/claude-opus-5.5 textimagefile in: text, image, file · out: text view answers → | 0.958 | 33/40 | $8.01 |
| 29 | google/gemini-3.7-flash textimagefilevideoaudio in: text, image, file, video, audio · out: text view answers → | 0.957 | 31/40 | $5.14 |
| 30 | anthropic/claude-opus-4.5 textimagefile in: text, image, file · out: text view answers → | 0.957 | 32/40 | $9.83 |
| 31 | sakana/fugu-ultra textimage in: text, image · out: text view answers → | 0.957 | 34/40 | $31.55 |
| 32 | deepseek/deepseek-flash-latest textimage in: text, image · out: text view answers → | 0.956 | 32/40 | $0.96 |
| 33 | meituan/longcat-2.0 text in: text · out: text view answers → | 0.955 | 32/40 | $0.63 |
| 34 | moonshotai/kimi-k2.7-code textimage in: text, image · out: text view answers → | 0.953 | 31/40 | $1.57 |
| 35 | qwen/qwen3.8-27b textimagevideo in: text, image, video · out: text view answers → | 0.953 | 32/40 | $1.63 |
| 36 | qwen/qwen3.8-max-prime textimagevideo in: text, image, video · out: text view answers → | 0.953 | 32/40 | $9.09 |
| 37 | openai/gpt-5.2-pro textimagefile in: text, image, file · out: text view answers → | 0.952 | 31/40 | $97.83 |
| 38 | openai/gpt-6-astra textimagefile in: text, image, file · out: text view answers → | 0.952 | 34/40 | $19.82 |
| 39 | xiaomi/mimo-v2.6-pro-ultraspeed textimagevideoaudio in: text, image, video, audio · out: text view answers → | 0.951 | 33/40 | $7.04 |
| 40 | anthropic/claude-opus-4.7 textimagefile in: text, image, file · out: text view answers → | 0.950 | 33/40 | $10.70 |
| 41 | qwen/qwen3.8-2.4t-a95b text in: text · out: text view answers → | 0.948 | 32/40 | $5.20 |
| 42 | deepseek/deepseek-v4-pro-0813 text in: text · out: text view answers → | 0.947 | 32/40 | $1.85 |
| 43 | openai/gpt-5.5 textimagefile in: text, image, file · out: text view answers → | 0.945 | 31/40 | $9.06 |
| 44 | openai/gpt-5.2 textimagefile in: text, image, file · out: text view answers → | 0.944 | 29/40 | $7.35 |
| 45 | minimax/minimax-m2.1 text in: text · out: text view answers → | 0.942 | 31/40 | $0.67 |
| 46 | stealth/space-bunny-alpha textimagevideo in: text, image, video · out: text view answers → | 0.942 · 38/40 final | 28/38 | $0.00 |
| 47 | openai/gpt-5.4-pro textimagefile in: text, image, file · out: text view answers → | 0.942 | 32/40 | $131.87 |
| 48 | anthropic/claude-opus-4.8 textimagefile in: text, image, file · out: text view answers → | 0.941 | 29/40 | $13.06 |
| 49 | openai/gpt-6-astra-pro textimagefile in: text, image, file · out: text view answers → | 0.941 | 32/40 | $43.54 |
| 50 | openai/gpt-6-sol textimagefile in: text, image, file · out: text view answers → | 0.941 | 29/40 | $7.59 |
| 51 | openai/gpt-5.6-sol textimagefile in: text, image, file · out: text view answers → | 0.940 | 29/40 | $3.67 |
| 52 | anthropic/claude-sonnet-5 textimagefile in: text, image, file · out: text view answers → | 0.940 | 32/40 | $8.38 |
| 53 | anthropic/claude-haiku-4.5 textimagefile in: text, image, file · out: text view answers → | 0.940 | 29/40 | $2.34 |
| 54 | deepseek/deepseek-v4-flash-0731 text in: text · out: text view answers → | 0.939 | 30/40 | $0.09 |
| 55 | poolside/laguna-s-2.1 text in: text · out: text view answers → | 0.939 · 39/40 final | 33/39 | $0.27 |
| 56 | nex-agi/nex-n2-mini text in: text · out: text view answers → | 0.939 · 28/40 final | 22/28 | $0.06 |
| 57 | openai/gpt-5.6-sol-pro textimagefile in: text, image, file · out: text view answers → | 0.937 | 31/40 | $7.97 |
| 58 | openai/gpt-5.6-luna textimagefile in: text, image, file · out: text view answers → | 0.936 | 30/40 | $0.42 |
| 59 | xiaomi/mimo-v2.5 textimagevideoaudio in: text, image, video, audio · out: text view answers → | 0.936 | 31/40 | $0.27 |
| 60 | deepseek/deepseek-v4-flash text in: text · out: text view answers → | 0.936 | 30/40 | $0.20 |
| 61 | openai/gpt-5.4-mini textimagefile in: text, image, file · out: text view answers → | 0.935 | 30/40 | $3.21 |
| 62 | openai/gpt-5.1 textimagefile in: text, image, file · out: text view answers → | 0.935 | 30/40 | $4.83 |
| 63 | openai/gpt-5.6-luna-pro textimagefile in: text, image, file · out: text view answers → | 0.934 | 29/40 | $1.04 |
| 64 | nex-agi/nex-n2-pro text in: text · out: text view answers → | 0.929 · 14/40 final | 10/14 | $0.05 |
| 65 | stepfun/step-3.5-flash text in: text · out: text view answers → | 0.928 | 29/40 | $0.45 |
| 66 | openai/gpt-5-pro textimagefile in: text, image, file · out: text view answers → | 0.927 | 29/40 | $93.00 |
| 67 | aion-labs/aion-3.5-mini text in: text · out: text view answers → | 0.926 · 36/40 final | 28/36 | $0.72 |
| 68 | meta/muse-glimmer-30b textimage in: text, image · out: text view answers → | 0.925 | 30/40 | $0.98 |
| 69 | openai/gpt-6-sol-pro textimagefile in: text, image, file · out: text view answers → | 0.921 | 29/40 | $15.93 |
| 70 | openai/gpt-5.4-nano textimagefile in: text, image, file · out: text view answers → | 0.920 | 26/40 | $1.04 |
| 71 | openai/gpt-5.6-terra textimagefile in: text, image, file · out: text view answers → | 0.920 | 27/40 | $3.67 |
| 72 | inclusionai/ling-3.0-flash text in: text · out: text view answers → | 0.919 | 28/40 | $0.06 |
| 73 | stepfun/step-3.7-flash textimagevideo in: text, image, video · out: text view answers → | 0.919 | 28/40 | $0.79 |
| 74 | minimax/minimax-m2.5 text in: text · out: text view answers → | 0.919 | 27/40 | $0.44 |
| 75 | openai/gpt-5 textimagefile in: text, image, file · out: text view answers → | 0.916 | 28/40 | $6.21 |
| 76 | thinkingmachines/inkling textimageaudio in: text, image, audio · out: text view answers → | 0.916 | 27/40 | $3.13 |
| 77 | openai/gpt-5.6-terra-pro textimagefile in: text, image, file · out: text view answers → | 0.915 | 26/40 | $7.98 |
| 78 | minimax/minimax-m2 text in: text · out: text view answers → | 0.914 | 28/40 | $1.19 |
| 79 | ibm-granite/granite-4.2-8b text in: text · out: text view answers → | 0.912 · 39/40 final | 24/39 | $0.36 |
| 80 | upstage/solar-pro4 text in: text · out: text view answers → | 0.909 | 29/40 | $0.05 |
| 81 | tencent/hy4-preview text in: text · out: text view answers → | 0.906 | 29/40 | $1.73 |
| 82 | qwen/qwen3.7-flash textimagevideo in: text, image, video · out: text view answers → | 0.906 | 27/40 | $0.08 |
| 83 | openai/gpt-6-luna textimagefile in: text, image, file · out: text view answers → | 0.904 | 27/40 | $0.28 |
| 84 | aion-labs/aion-3.0 text in: text · out: text view answers → | 0.904 · 39/40 final | 32/39 | $3.54 |
| 85 | bytedance-seed/seed-2.0-mini textimagevideo in: text, image, video · out: text view answers → | 0.900 | 28/40 | $0.12 |
| 86 | openai/gpt-chat-latest textimagefile in: text, image, file · out: text view answers → | 0.899 | 27/40 | $3.77 |
| 87 | openai/gpt-5-mini textimagefile in: text, image, file · out: text view answers → | 0.896 | 30/40 | $1.04 |
| 88 | google/gemma-4-31b-it textimagevideo in: text, image, video · out: text view answers → | 0.889 | 24/40 | $0.16 |
| 89 | bytedance-seed/seed-1.6 textimagevideo in: text, image, video · out: text view answers → | 0.880 | 26/40 | $0.71 |
| 90 | minimax/minimax-m3 textimagevideo in: text, image, video · out: text view answers → | 0.878 | 26/40 | $0.62 |
| 91 | aion-labs/aion-3.0-mini text in: text · out: text view answers → | 0.874 | 28/40 | $1.29 |
| 92 | openai/gpt-6-luna-pro textimagefile in: text, image, file · out: text view answers → | 0.874 | 25/40 | $0.58 |
| 93 | arcee-ai/trinity-large-thinking text in: text · out: text view answers → | 0.869 | 26/40 | $0.68 |
| 94 | google/gemini-3-pro-image textimageout:image in: text, image · out: text, image view answers → | 0.868 | 26/40 | $3.80 |
| 95 | inception/mercury-2.5-preview text in: text · out: text view answers → | 0.867 | 26/40 | $0.10 |
| 96 | deepseek/deepseek-v3.2 text in: text · out: text view answers → | 0.863 | 23/40 | $0.97 |
| 97 | cohere/command-a-plus textimage in: text, image · out: text view answers → | 0.863 | 24/40 | $3.06 |
| 98 | poolside/laguna-xs-2.1 text in: text · out: text view answers → | 0.858 | 20/40 | $0.36 |
| 99 | aion-labs/aion-2.0 text in: text · out: text view answers → | 0.853 | 26/40 | $0.76 |
| 100 | thinkingmachines/inkling-small textimageaudio in: text, image, audio · out: text view answers → | 0.851 | 23/40 | $0.89 |
| 101 | google/gemma-4-26b-a4b-it textimagevideo in: text, image, video · out: text view answers → | 0.849 | 20/40 | $0.11 |
| 102 | upstage/solar-mini4 text in: text · out: text view answers → | 0.814 | 20/40 | $0.08 |
| 103 | mistralai/devstral-2512 textfile in: text, file · out: text view answers → | 0.791 | 16/40 | $0.69 |
| 104 | openai/gpt-5-nano textimagefile in: text, image, file · out: text view answers → | 0.790 | 17/40 | $0.35 |
| 105 | inception/mercury-2 text in: text · out: text view answers → | 0.789 | 19/40 | $0.82 |
| 106 | nvidia/nemotron-3.5-lightning text in: text · out: text view answers → | 0.776 | 15/40 | $0.32 |
| 107 | openai/o4-mini textimagefile in: text, image, file · out: text view answers → | 0.772 | 17/40 | $1.76 |
| 108 | mistralai/ministral-14b-2512 textimage in: text, image · out: text view answers → | 0.755 | 19/40 | $0.43 |
| 109 | inclusionai/ling-3.0-flash-fin text in: text · out: text view answers → | 0.741 | 17/40 | $0.15 |
| 110 | mistralai/mistral-medium-3-5 textimagefile in: text, image, file · out: text view answers → | 0.734 | 14/40 | $1.49 |
| 111 | mistralai/ministral-3b-2512 textimage in: text, image · out: text view answers → | 0.732 | 15/40 | $0.22 |
| 112 | nvidia/nemotron-3-nano-30b-a3b text in: text · out: text view answers → | 0.728 | 15/40 | $0.73 |
| 113 | openai/o3 textimagefile in: text, image, file · out: text view answers → | 0.715 | 17/40 | $4.13 |
| 114 | mistralai/mistral-small-2603 textimage in: text, image · out: text view answers → | 0.707 | 10/40 | $0.13 |
| 115 | amazon/nova-premier-v1 textimage in: text, image · out: text view answers → | 0.694 | 16/40 | $10.09 |
| 116 | meta-llama/llama-4-maverick textimage in: text, image · out: text view answers → | 0.689 | 14/40 | $0.24 |
| 117 | meta-llama/llama-3.3-70b-instruct text in: text · out: text view answers → | 0.683 | 16/40 | $0.05 |
| 118 | upstage/solar-pro-3 text in: text · out: text view answers → | 0.645 | 13/40 | $0.69 |
| 119 | amazon/nova-pro-v1 textimage in: text, image · out: text view answers → | 0.614 | 9/40 | $4.81 |