← Models

Model profile

Llama 3.2 90B Vision Instruct

Metadeveloper
2024-09-19release date
#228 / 267overall rank
3eval lineages

Evidence summary

Llama 3.2 90B Vision Instruct has an estimated overall rank of #228; its 90% source-sensitivity interval is #144–#253. Its behavior-only rank is #218; company governance moves the combined estimate to #228. Published evidence spans 3 evals and 3 of 7 behavior components. Its strongest relative result is SafeArena (normalized_safety_score, #3 of 5); its weakest is MASK (lying_probability_pct, #36 of 53).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionBetterSource
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#70 / 10553.94↓ lowerSource ↗official
MASKlying_probability_pct#36 / 5345.93↓ lowerSource ↗official
SafeArenanormalized_safety_score#3 / 534↑ higherSource ↗official