Which models need more safety evaluations?
This planning view combines current model popularity and important-release signals with the safety evidence already in the index, then ranks runnable missing model × eval bundles by their potential effect on the index.
- 37
- unique model targets
- 1
- with no ingested safety evals
- 6
- below three components
- 12
- selected by multiple sources
How this list is constructed
Each source contributes 20 currently available generative LLM products. Reasoning levels, hosted routes, free variants, and dated snapshots are merged into one evaluation target. Artificial Analysis contributes the highest Intelligence Index observed across each model's reasoning configurations; Epoch contributes its 20 most recent reviewed accessible notable language models. Source ranks are not averaged because monthly usage, downloads, catalog popularity, intelligence, and curated notability measure different things.
Popularity and important-release coverage
The table is ordered by number of source appearances, then best source-local rank. Every source is limited to its top 20, and at most five models appearing on only one source are shown per source. The five highest-ranked single-source models are normally retained; for Artificial Analysis, a higher-ranked priced versioned successor may replace the fifth row when its older base product is already retained through another source. OpenRouter prices are dollars per million tokens for any joined current paid route, whether or not OpenRouter popularity caused the model's inclusion; blank prices mean no joined paid route, not free usage. Hugging Face includes downloadable/self-hosted models updated within the past year.
| Model | Why included | Evals | Components | Input | Output | Cache read |
|---|---|---|---|---|---|---|
DeepSeek V4 Flash 0423deepseek-v4-flash | Openrouter #1Huggingface #12Nvidia #7Epoch #7Openrouter: 35T tokens | Huggingface: 2.5M downloads | Nvidia: popularity 1.7M | Epoch: released 2026-04-24 | 20 | 7/7 | $0.068 | $0.14 | $0.014 |
Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55b | Openrouter #6Nvidia #2Epoch #4Openrouter: 12T tokens | Nvidia: popularity 5.2M | Epoch: released 2026-06-04 | 10 | 7/7 | $0.3 | $1.8 | $0.1 |
GLM 5.2glm-5.2 | Openrouter #4Huggingface #15Nvidia #12Openrouter: 14T tokens | Huggingface: 2.3M downloads | Nvidia: popularity 803K | 26 | 7/7 | $0.098 | $0.31 | $0.018 |
DeepSeek V4 Prodeepseek-v4-pro | Openrouter #5Nvidia #13Epoch #6Openrouter: 12T tokens | Nvidia: popularity 673K | Epoch: released 2026-04-24 | 24 | 7/7 | $0.11 | $0.22 | $0.0091 |
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4nemotron-3-super-120b-a12b | Huggingface #11Nvidia #1Huggingface: 2.7M downloads | Nvidia: popularity 6.5M | 11 | 6/7 | $0.085 | $0.4 | — |
gpt-oss-120bgpt-oss-120b | Huggingface #7Nvidia #3Huggingface: 4.1M downloads | Nvidia: popularity 4.5M | 35 | 7/7 | $0.03 | $0.17 | $0.03 |
gpt-oss-20bgpt-oss-20b | Huggingface #3Nvidia #5Huggingface: 8.1M downloads | Nvidia: popularity 1.9M | 20 | 7/7 | $0.03 | $0.13 | $0.03 |
Claude Opus 4.8 (batch)claude-opus-4.8 | Openrouter #10Epoch #5Openrouter: 5.3T tokens | Epoch: released 2026-05-28 | 33 | 7/7 | $2.5 | $12.0 | $0.25 |
kimi-k2.6kimi-k2.6 | Nvidia #8Epoch #12Nvidia: popularity 1.6M | Epoch: released 2026-04-20 | 24 | 7/7 | $0.58 | $2.4 | $0.098 |
Claude Opus 4.7 (batch)claude-opus-4.7 | Openrouter #12Epoch #13Openrouter: 4.3T tokens | Epoch: released 2026-04-16 | 38 | 7/7 | $2.5 | $12.0 | $0.25 |
Kimi K3kimi-k3 | Openrouter #13Artificial Analysis #13Openrouter: 4.2T tokens | Artificial Analysis: Intelligence Index v4.3.2 43.6 | 26 | 7/7 | $2.8 | $14.0 | $0.29 |
Gemma-4-31B-IT-NVFP4gemma-4-31b-it | Huggingface #14Nvidia #15Huggingface: 2.5M downloads | Nvidia: popularity 571K | 17 | 7/7 | $0.08 | $0.35 | $0.01 |
Claude Opus 5.5claude-opus-5.5 | Artificial Analysis #1Artificial Analysis: Intelligence Index v4.3.2 57.6 | 12 | 7/7 | — | — | — |
Inklinginkling | Epoch #1Epoch: released 2026-07-15 | 10 | 6/7 | $0.5 | $2 | $0.085 |
Qwen3-0.6Bqwen3-0.6b | Huggingface #1Huggingface: 28M downloads | 2 | 1/7 | — | — | — |
Claude Sonnet 5.5claude-sonnet-5.5 | Artificial Analysis #2Artificial Analysis: Intelligence Index v4.3.2 56.0 | 5 | 4/7 | — | — | — |
MiMo-V2.5mimo-v2.5 | Openrouter #2Openrouter: 34T tokens | 8 | 5/7 | $0.14 | $0.28 | $0.0028 |
Qwen3-8Bqwen3-8b | Huggingface #2Huggingface: 15M downloads | 10 | 6/7 | — | — | — |
Solar Open2 250Bsolar-open2-250b | Epoch #2Epoch: released 2026-06-28 | 1 | 1/7 | — | — | — |
Claude Fable 5claude-fable-5 | Epoch #3Epoch: released 2026-06-09 | 27 | 7/7 | $5 | $25.0 | $0.5 |
Claude Fable 5.1claude-fable-5.1 | Artificial Analysis #3Artificial Analysis: Intelligence Index v4.3.2 53.4 | 20 | 7/7 | — | — | — |
Hy3hy3 | Openrouter #3Openrouter: 32T tokens | 6 | 5/7 | $0.13 | $0.53 | $0.032 |
GPT-6 Astragpt-6-astra | Artificial Analysis #4Artificial Analysis: Intelligence Index v4.3.2 52.7 | 18 | 7/7 | — | — | — |
llama-3.3-70b-instructllama-3.3-70b-instruct | Nvidia #4Nvidia: popularity 2.7M | 32 | 7/7 | $0.1 | $0.32 | — |
Qwen3-32Bqwen3-32b | Huggingface #4Huggingface: 7.6M downloads | 9 | 7/7 | — | — | — |
Gemini 4 Argongemini-4-argon | Artificial Analysis #5Artificial Analysis: Intelligence Index v4.3.2 52.6 | 1 | 1/7 | — | — | — |
Qwen3-1.7Bqwen3-1.7b | Huggingface #5Huggingface: 7.5M downloads | 1 | 1/7 | — | — | — |
llama-3.1-8b-instructllama-3.1-8b-instruct | Nvidia #6Nvidia: popularity 1.9M | 32 | 7/7 | $0.02 | $0.04 | — |
Qwen3-4Bqwen3-4b | Huggingface #6Huggingface: 4.5M downloads | 4 | 5/7 | — | — | — |
MiniMax M3 (batch)minimax-m3 | Openrouter #7Openrouter: 11T tokens | 11 | 6/7 | $0.15 | $0.6 | $0.03 |
GPT-5.6 Luna (batch)gpt-5.6-luna | Openrouter #8Openrouter: 6.5T tokens | 28 | 7/7 | $0.1 | $0.6 | $0.01 |
Tencent Hy3 previewhy3-preview | Epoch #8Epoch: released 2026-04-23 | 5 | 5/7 | $0.063 | $0.21 | $0.021 |
llama-3.1-nemotron-nano-vl-8b-v1llama-3-1-nemotron-nano-vl-8b-v1 | Nvidia #9Nvidia: popularity 1.4M | 0 | 0/7 | — | — | — |
MiMo-V2.5-Promimo-v2.5-pro | Epoch #9Epoch: released 2026-04-23 | 9 | 6/7 | $0.4 | $1.5 | $0.08 |
Step 3.7 Flashstep-3.7-flash | Openrouter #9Openrouter: 5.9T tokens | 3 | 2/7 | $0.2 | $1.1 | $0.04 |
nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3b | Nvidia #10Nvidia: popularity 1.2M | 8 | 4/7 | $0.05 | $0.2 | $0.03 |
nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3b | Nvidia #11Nvidia: popularity 846K | 3 | 5/7 | — | — | — |
Missing eval × model priorities
Experimental multi-signal ranking
Each row adds the model at the observed 10th and 90th percentiles of one eval lineage and refits the production estimator. Target rank change compares each scenario with the model's current behavior rank. Other-model spillover averages absolute rank changes from the two scenarios after removing the evaluated model from every comparison ranking, so merely crossing that model does not count. The displayed rows are the deduplicated union of the top candidates on those two signals; badges show each signal-local rank. Scenario values are sensitivities, not calibrated expected changes.
| Why selected | Model | Eval | Target rank change | Other-model spillover |
|---|---|---|---|---|
| Target #29Spillover #1 | Hy3hy3 | CAIS Risk Index agent red teaming | down 117 / up 30current behavior rank #107 | 24.0 |
| Target #1 | Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55b | AILuminate General Purpose AI Chat | down 189 / down 98current behavior rank #105 | 21.0 |
| Target #7Spillover #2 | Hy3hy3 | AILuminate General Purpose AI Chat | down 186 / up 29current behavior rank #107 | 24.0 |
| Target #2 | Qwen3-4Bqwen3-4b | AILuminate General Purpose AI Chat | down 214 / up 60current behavior rank #64 | 22.0 |
| Target #3Spillover #4 | Qwen3-32Bqwen3-32b | AILuminate General Purpose AI Chat | down 270 / up 2current behavior rank #6 | 23.0 |
| Spillover #3 | GLM 5.2glm-5.2 | AILuminate General Purpose AI Chat | up 19 / up 19current behavior rank #113 | 23.0 |
| Target #4 | nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3b | AILuminate General Purpose AI Chat | down 230 / up 24current behavior rank #68 | 22.0 |
| Target #5 | Claude Sonnet 5.5claude-sonnet-5.5 | AILuminate General Purpose AI Chat | down 239 / up 12current behavior rank #50 | 22.0 |
| Spillover #5 | Tencent Hy3 previewhy3-preview | MASK | down 60 / up 24current behavior rank #147 | 23.0 |
| Target #6 | nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3b | AILuminate General Purpose AI Chat | down 194 / up 46current behavior rank #91 | 22.0 |
| Spillover #6 | llama-3.1-nemotron-nano-vl-8b-v1llama-3-1-nemotron-nano-vl-8b-v1 | DystopiaBench | Not currently ranked | 23.0 |
| Target #24Spillover #7 | Tencent Hy3 previewhy3-preview | AILuminate General Purpose AI Chat | down 148 / up 15current behavior rank #147 | 23.0 |
| Target #8 | NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4nemotron-3-super-120b-a12b | AILuminate General Purpose AI Chat | down 150 / down 61current behavior rank #145 | 22.0 |
| Spillover #8 | Tencent Hy3 previewhy3-preview | Alignment Leaderboard | down 70 / up 21current behavior rank #147 | 23.0 |
| Target #34Spillover #9 | Hy3hy3 | FORTRESS | down 111 / up 30current behavior rank #107 | 23.0 |
| Target #9 | Qwen3-4Bqwen3-4b | Alignment Leaderboard | down 150 / up 60current behavior rank #64 | 21.0 |
| Target #10 | Qwen3-4Bqwen3-4b | FORTRESS | down 147 / up 60current behavior rank #64 | 21.0 |
| Target #12Spillover #29 | Qwen3-32Bqwen3-32b | DystopiaBench | down 198 / up 2current behavior rank #6 | 22.0 |
| Target #13 | Qwen3-32Bqwen3-32b | FORTRESS | down 198 / up 2current behavior rank #6 | 22.0 |
| Spillover #13 | Qwen3-0.6Bqwen3-0.6b | ODCV-Bench | Not currently ranked | 23.0 |
| Spillover #14 | llama-3.1-8b-instructllama-3.1-8b-instruct | DystopiaBench | down 13 / down 12current behavior rank #269 | 23.0 |
| Target #15 | Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55b | HELM Anthropic red-team | down 99 / down 98current behavior rank #105 | 21.0 |
| Target #16 | Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55b | CAIS Risk Index bioweapons assistance | down 98 / down 98current behavior rank #105 | 22.0 |
| Spillover #16 | DeepSeek V4 Prodeepseek-v4-pro | CAIS Risk Index agent red teaming | up 56 / up 56current behavior rank #148 | 23.0 |
| Target #18 | Inklinginkling | DystopiaBench | down 157 / down 27current behavior rank #47 | 22.0 |
| Spillover #18 | DeepSeek V4 Prodeepseek-v4-pro | MACHIAVELLI | up 56 / up 56current behavior rank #148 | 23.0 |
| Target #19 | Claude Sonnet 5.5claude-sonnet-5.5 | FORTRESS | down 145 / up 35current behavior rank #50 | 22.0 |
| Spillover #19 | kimi-k2.6kimi-k2.6 | ANIMA | down 28 / up 29current behavior rank #79 | 23.0 |
| Target #32Spillover #20 | nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3b | DystopiaBench | down 120 / up 22current behavior rank #91 | 23.0 |
| Spillover #21 | Gemini 4 Argongemini-4-argon | Alignment Leaderboard | Not currently ranked | 22.0 |
| Spillover #22 | Solar Open2 250Bsolar-open2-250b | MASK | Not currently ranked | 22.0 |
| Target #23 | nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3b | MACHIAVELLI | down 115 / up 49current behavior rank #91 | 22.0 |
| Spillover #25 | GLM 5.2glm-5.2 | DystopiaBench | up 16 / up 24current behavior rank #113 | 22.0 |
| Target #26 | nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3b | FORTRESS | down 133 / up 26current behavior rank #68 | 22.0 |
| Spillover #26 | Solar Open2 250Bsolar-open2-250b | MACHIAVELLI | Not currently ranked | 22.0 |
| Spillover #28 | GPT-6 Astragpt-6-astra | HELM Anthropic red-team | no change / no changecurrent behavior rank #2 | 22.0 |
| Target #30 | nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3b | Alignment Leaderboard | down 139 / up 6current behavior rank #68 | 22.0 |
| Spillover #30 | Claude Fable 5.1claude-fable-5.1 | HELM Anthropic red-team | no change / no changecurrent behavior rank #18 | 22.0 |
| Spillover #31 | Claude Fable 5claude-fable-5 | HELM Anthropic red-team | no change / no changecurrent behavior rank #23 | 22.0 |
| Spillover #32 | Claude Opus 4.8 (batch)claude-opus-4.8 | HELM Anthropic red-team | up 1 / up 1current behavior rank #25 | 22.0 |