Modality data refreshed from the live model catalog · 117 models

Modality first. Score second.

A model that cannot see an image will never pass a screenshot test, no matter how it ranks. Before comparing scores, check what a model can actually take in. Pick a group below.

01 · WHAT MODALITIES ARE

What a model can take in, and what it can put out.

Every model has an input side and an output side. The input side is what you can hand it: text (a prompt), image (a screenshot or photo), file (a PDF or document attachment), video, and audio. The output side is what it can produce — every model in this run writes text; a few also generate images.

This is not a quality feature. It is a capability feature. A text-only model at the top of the leaderboard is still the wrong tool for "here's a screenshot of the bug." The benchmark tests operational GTM work in text, so every model here could run it — but the moment your job involves looking at something, the field narrows.

Why the word modality. It means data type. Text is one. Image is another. A model's modality is its senses. Text plus image reads a screenshot directly. Text only cannot.

Background: what multimodal models are. Two paths exist. Native reads image and text together. Pipeline turns the image into text first. Your IDE usually handles the pipeline for you. That holds until the job needs the look itself.

Worth knowing with open models: vision varies by endpoint. Some DeepSeek endpoints are text only, while Flash adds it (see the vision guide). If you plan real work on open models, check the endpoint takes what you send.

02 · THE THREE GROUPS

117 models, three modality archetypes.

Grouped by input modalities from the live OpenRouter catalog. A model appears in exactly one group, ordered by input range. Pick a group:

Media Generalists

The widest input range in the run: text, images, files, and in many cases video or audio. Best fit for agent roles that meet people where they are — Slack, email, shared drives.

31 of 117 modelsmedian mean 0.970text · image · file · video · audio
ModelMeanPerfectReads
meta/muse-wonder0.99639/40text, image, file, video, audio
elorian/glimpse0.99038/40text, image, video
xiaomi/mimo-v2.6-pro0.98936/38text, image, video, audio
meta/muse-spark-1.10.98637/40text, image, file, video
moonshotai/kimi-k30.98537/40text, image, video
z-ai/glm-5.3-flashx0.98337/40text, image, video
z-ai/glm-5v-turbo0.98233/36text, image, video
stepfun/step-5-preview0.98136/40text, image, video

Ranked by mean score in the 40-task run. Modality data comes from each model's published architecture, re-checked at every monthly refresh. n/40 means the model ran every task; partial runs are labeled in the full matrix.

Image Readers

Everything a text model does, plus screenshots and photos. Most also read attached files. This is the floor for any job where a person might paste in what they are looking at.

53 of 117 modelsmedian mean 0.945text · image · file
ModelMeanPerfectReads
fireworks/ember-10.98938/40text, image
unbiased/pareto-26.90.98237/40text, image
scaledown/summarize0.98136/40text, image, file
anthropic/claude-opus-50.97637/40text, image, file
unbiased/pareto-26.100.96835/40text, image
anthropic/claude-opus-4.50.96633/40text, image, file
~unbiased/pareto-latest0.96634/40text, image
openai/gpt-5.5-pro0.96634/40text, image, file

Ranked by mean score in the 40-task run. Modality data comes from each model's published architecture, re-checked at every monthly refresh. n/40 means the model ran every task; partial runs are labeled in the full matrix.

Text Specialists

Text in, text out. No screenshots, no media. One of them also reads file attachments. Ask one to look at an image and it simply cannot.

33 of 117 modelsmedian mean 0.952text
ModelMeanPerfectReads
deepseek/deepseek-pro-latest0.99038/40text
inclusionai/ling-3.1-flash0.98922/23text
xiaomi/mimo-v2.5-pro0.97836/40text
tencent/hy3-preview0.97735/40text
z-ai/glm-5.3-prime0.97633/37text
unbiased/pareto0.97336/40text
z-ai/glm-5.10.97334/40text
z-ai/glm-5-turbo0.97328/31text

Ranked by mean score in the 40-task run. Modality data comes from each model's published architecture, re-checked at every monthly refresh. n/40 means the model ran every task; partial runs are labeled in the full matrix.