Which models need more safety evaluations?

This planning view combines current model popularity and important-release signals with the safety evidence already in the index, then ranks runnable missing model × eval bundles by their potential effect on the index.

37
unique model targets
1
with no ingested safety evals
6
below three components
12
selected by multiple sources

How this list is constructed

Each source contributes 20 currently available generative LLM products. Reasoning levels, hosted routes, free variants, and dated snapshots are merged into one evaluation target. Artificial Analysis contributes the highest Intelligence Index observed across each model's reasoning configurations; Epoch contributes its 20 most recent reviewed accessible notable language models. Source ranks are not averaged because monthly usage, downloads, catalog popularity, intelligence, and curated notability measure different things.

Popularity and important-release coverage

The table is ordered by number of source appearances, then best source-local rank. Every source is limited to its top 20, and at most five models appearing on only one source are shown per source. The five highest-ranked single-source models are normally retained; for Artificial Analysis, a higher-ranked priced versioned successor may replace the fifth row when its older base product is already retained through another source. OpenRouter prices are dollars per million tokens for any joined current paid route, whether or not OpenRouter popularity caused the model's inclusion; blank prices mean no joined paid route, not free usage. Hugging Face includes downloadable/self-hosted models updated within the past year.

Top-20 selections from OpenRouter, Hugging Face, NVIDIA, Artificial Analysis, and Epoch; 37 models shown after the five-per-source single-source cap.
ModelWhy includedEvalsComponentsInputOutputCache read
DeepSeek V4 Flash 0423deepseek-v4-flashOpenrouter #1Huggingface #12Nvidia #7Epoch #7Openrouter: 35T tokens | Huggingface: 2.5M downloads | Nvidia: popularity 1.7M | Epoch: released 2026-04-24207/7$0.068$0.14$0.014
Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55bOpenrouter #6Nvidia #2Epoch #4Openrouter: 12T tokens | Nvidia: popularity 5.2M | Epoch: released 2026-06-04107/7$0.3$1.8$0.1
GLM 5.2glm-5.2Openrouter #4Huggingface #15Nvidia #12Openrouter: 14T tokens | Huggingface: 2.3M downloads | Nvidia: popularity 803K267/7$0.098$0.31$0.018
DeepSeek V4 Prodeepseek-v4-proOpenrouter #5Nvidia #13Epoch #6Openrouter: 12T tokens | Nvidia: popularity 673K | Epoch: released 2026-04-24247/7$0.11$0.22$0.0091
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4nemotron-3-super-120b-a12bHuggingface #11Nvidia #1Huggingface: 2.7M downloads | Nvidia: popularity 6.5M116/7$0.085$0.4—
gpt-oss-120bgpt-oss-120bHuggingface #7Nvidia #3Huggingface: 4.1M downloads | Nvidia: popularity 4.5M357/7$0.03$0.17$0.03
gpt-oss-20bgpt-oss-20bHuggingface #3Nvidia #5Huggingface: 8.1M downloads | Nvidia: popularity 1.9M207/7$0.03$0.13$0.03
Claude Opus 4.8 (batch)claude-opus-4.8Openrouter #10Epoch #5Openrouter: 5.3T tokens | Epoch: released 2026-05-28337/7$2.5$12.0$0.25
kimi-k2.6kimi-k2.6Nvidia #8Epoch #12Nvidia: popularity 1.6M | Epoch: released 2026-04-20247/7$0.58$2.4$0.098
Claude Opus 4.7 (batch)claude-opus-4.7Openrouter #12Epoch #13Openrouter: 4.3T tokens | Epoch: released 2026-04-16387/7$2.5$12.0$0.25
Kimi K3kimi-k3Openrouter #13Artificial Analysis #13Openrouter: 4.2T tokens | Artificial Analysis: Intelligence Index v4.3.2 43.6267/7$2.8$14.0$0.29
Gemma-4-31B-IT-NVFP4gemma-4-31b-itHuggingface #14Nvidia #15Huggingface: 2.5M downloads | Nvidia: popularity 571K177/7$0.08$0.35$0.01
Claude Opus 5.5claude-opus-5.5Artificial Analysis #1Artificial Analysis: Intelligence Index v4.3.2 57.6127/7———
InklinginklingEpoch #1Epoch: released 2026-07-15106/7$0.5$2$0.085
Qwen3-0.6Bqwen3-0.6bHuggingface #1Huggingface: 28M downloads21/7———
Claude Sonnet 5.5claude-sonnet-5.5Artificial Analysis #2Artificial Analysis: Intelligence Index v4.3.2 56.054/7———
MiMo-V2.5mimo-v2.5Openrouter #2Openrouter: 34T tokens85/7$0.14$0.28$0.0028
Qwen3-8Bqwen3-8bHuggingface #2Huggingface: 15M downloads106/7———
Solar Open2 250Bsolar-open2-250bEpoch #2Epoch: released 2026-06-2811/7———
Claude Fable 5claude-fable-5Epoch #3Epoch: released 2026-06-09277/7$5$25.0$0.5
Claude Fable 5.1claude-fable-5.1Artificial Analysis #3Artificial Analysis: Intelligence Index v4.3.2 53.4207/7———
Hy3hy3Openrouter #3Openrouter: 32T tokens65/7$0.13$0.53$0.032
GPT-6 Astragpt-6-astraArtificial Analysis #4Artificial Analysis: Intelligence Index v4.3.2 52.7187/7———
llama-3.3-70b-instructllama-3.3-70b-instructNvidia #4Nvidia: popularity 2.7M327/7$0.1$0.32—
Qwen3-32Bqwen3-32bHuggingface #4Huggingface: 7.6M downloads97/7———
Gemini 4 Argongemini-4-argonArtificial Analysis #5Artificial Analysis: Intelligence Index v4.3.2 52.611/7———
Qwen3-1.7Bqwen3-1.7bHuggingface #5Huggingface: 7.5M downloads11/7———
llama-3.1-8b-instructllama-3.1-8b-instructNvidia #6Nvidia: popularity 1.9M327/7$0.02$0.04—
Qwen3-4Bqwen3-4bHuggingface #6Huggingface: 4.5M downloads45/7———
MiniMax M3 (batch)minimax-m3Openrouter #7Openrouter: 11T tokens116/7$0.15$0.6$0.03
GPT-5.6 Luna (batch)gpt-5.6-lunaOpenrouter #8Openrouter: 6.5T tokens287/7$0.1$0.6$0.01
Tencent Hy3 previewhy3-previewEpoch #8Epoch: released 2026-04-2355/7$0.063$0.21$0.021
llama-3.1-nemotron-nano-vl-8b-v1llama-3-1-nemotron-nano-vl-8b-v1Nvidia #9Nvidia: popularity 1.4M00/7———
MiMo-V2.5-Promimo-v2.5-proEpoch #9Epoch: released 2026-04-2396/7$0.4$1.5$0.08
Step 3.7 Flashstep-3.7-flashOpenrouter #9Openrouter: 5.9T tokens32/7$0.2$1.1$0.04
nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3bNvidia #10Nvidia: popularity 1.2M84/7$0.05$0.2$0.03
nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3bNvidia #11Nvidia: popularity 846K35/7———

Missing eval × model priorities

Experimental multi-signal ranking

Each row adds the model at the observed 10th and 90th percentiles of one eval lineage and refits the production estimator. Target rank change compares each scenario with the model's current behavior rank. Other-model spillover averages absolute rank changes from the two scenarios after removing the evaluated model from every comparison ranking, so merely crossing that model does not count. The displayed rows are the deduplicated union of the top candidates on those two signals; badges show each signal-local rank. Scenario values are sensitivities, not calibrated expected changes.

Top 40 runnable missing model × eval candidates selected across two signals. At most three rows per model.
Why selectedModelEvalTarget rank changeOther-model spillover
Target #29Spillover #1Hy3hy3CAIS Risk Index agent red teamingdown 117 / up 30current behavior rank #10724.0
Target #1Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55bAILuminate General Purpose AI Chatdown 189 / down 98current behavior rank #10521.0
Target #7Spillover #2Hy3hy3AILuminate General Purpose AI Chatdown 186 / up 29current behavior rank #10724.0
Target #2Qwen3-4Bqwen3-4bAILuminate General Purpose AI Chatdown 214 / up 60current behavior rank #6422.0
Target #3Spillover #4Qwen3-32Bqwen3-32bAILuminate General Purpose AI Chatdown 270 / up 2current behavior rank #623.0
Spillover #3GLM 5.2glm-5.2AILuminate General Purpose AI Chatup 19 / up 19current behavior rank #11323.0
Target #4nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3bAILuminate General Purpose AI Chatdown 230 / up 24current behavior rank #6822.0
Target #5Claude Sonnet 5.5claude-sonnet-5.5AILuminate General Purpose AI Chatdown 239 / up 12current behavior rank #5022.0
Spillover #5Tencent Hy3 previewhy3-previewMASKdown 60 / up 24current behavior rank #14723.0
Target #6nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3bAILuminate General Purpose AI Chatdown 194 / up 46current behavior rank #9122.0
Spillover #6llama-3.1-nemotron-nano-vl-8b-v1llama-3-1-nemotron-nano-vl-8b-v1DystopiaBenchNot currently ranked23.0
Target #24Spillover #7Tencent Hy3 previewhy3-previewAILuminate General Purpose AI Chatdown 148 / up 15current behavior rank #14723.0
Target #8NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4nemotron-3-super-120b-a12bAILuminate General Purpose AI Chatdown 150 / down 61current behavior rank #14522.0
Spillover #8Tencent Hy3 previewhy3-previewAlignment Leaderboarddown 70 / up 21current behavior rank #14723.0
Target #34Spillover #9Hy3hy3FORTRESSdown 111 / up 30current behavior rank #10723.0
Target #9Qwen3-4Bqwen3-4bAlignment Leaderboarddown 150 / up 60current behavior rank #6421.0
Target #10Qwen3-4Bqwen3-4bFORTRESSdown 147 / up 60current behavior rank #6421.0
Target #12Spillover #29Qwen3-32Bqwen3-32bDystopiaBenchdown 198 / up 2current behavior rank #622.0
Target #13Qwen3-32Bqwen3-32bFORTRESSdown 198 / up 2current behavior rank #622.0
Spillover #13Qwen3-0.6Bqwen3-0.6bODCV-BenchNot currently ranked23.0
Spillover #14llama-3.1-8b-instructllama-3.1-8b-instructDystopiaBenchdown 13 / down 12current behavior rank #26923.0
Target #15Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55bHELM Anthropic red-teamdown 99 / down 98current behavior rank #10521.0
Target #16Nemotron 3 Ultra (batch)nemotron-3-ultra-550b-a55bCAIS Risk Index bioweapons assistancedown 98 / down 98current behavior rank #10522.0
Spillover #16DeepSeek V4 Prodeepseek-v4-proCAIS Risk Index agent red teamingup 56 / up 56current behavior rank #14823.0
Target #18InklinginklingDystopiaBenchdown 157 / down 27current behavior rank #4722.0
Spillover #18DeepSeek V4 Prodeepseek-v4-proMACHIAVELLIup 56 / up 56current behavior rank #14823.0
Target #19Claude Sonnet 5.5claude-sonnet-5.5FORTRESSdown 145 / up 35current behavior rank #5022.0
Spillover #19kimi-k2.6kimi-k2.6ANIMAdown 28 / up 29current behavior rank #7923.0
Target #32Spillover #20nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3bDystopiaBenchdown 120 / up 22current behavior rank #9123.0
Spillover #21Gemini 4 Argongemini-4-argonAlignment LeaderboardNot currently ranked22.0
Spillover #22Solar Open2 250Bsolar-open2-250bMASKNot currently ranked22.0
Target #23nemotron-3-nano-30b-a3bnemotron-3-nano-30b-a3bMACHIAVELLIdown 115 / up 49current behavior rank #9122.0
Spillover #25GLM 5.2glm-5.2DystopiaBenchup 16 / up 24current behavior rank #11322.0
Target #26nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3bFORTRESSdown 133 / up 26current behavior rank #6822.0
Spillover #26Solar Open2 250Bsolar-open2-250bMACHIAVELLINot currently ranked22.0
Spillover #28GPT-6 Astragpt-6-astraHELM Anthropic red-teamno change / no changecurrent behavior rank #222.0
Target #30nemotron-3-nano-omni-30b-a3b-reasoningnemotron-3-nano-omni-30b-a3bAlignment Leaderboarddown 139 / up 6current behavior rank #6822.0
Spillover #30Claude Fable 5.1claude-fable-5.1HELM Anthropic red-teamno change / no changecurrent behavior rank #1822.0
Spillover #31Claude Fable 5claude-fable-5HELM Anthropic red-teamno change / no changecurrent behavior rank #2322.0
Spillover #32Claude Opus 4.8 (batch)claude-opus-4.8HELM Anthropic red-teamup 1 / up 1current behavior rank #2522.0