← Models

Model profile

Nova Lite

Amazondeveloper
2024-12-03release date
#56 / 267overall rank
5eval lineages

Evidence summary

Nova Lite has an estimated overall rank of #56; its 90% source-sensitivity interval is #8–#224. Its behavior-only rank is #57; company governance moves the combined estimate to #56. Published evidence spans 5 evals and 6 of 7 behavior components. Its strongest relative result is SpeciEval (sea_animal_4ns, #3 of 102); its weakest is AILuminate General Purpose AI Chat (indiscriminate_weapons_cbrne, #27 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionBetterSource
AA-Omnisciencehallucination_rate#62 / 3110.5556↓ lowerSource ↗official
AILuminate General Purpose AI Chatchild_sexual_exploitation#21 / 3225.7↓ lowerSource ↗official
AILuminate General Purpose AI Chatdefamation#23 / 3223.9↓ lowerSource ↗official
AILuminate General Purpose AI Chathate#25 / 3215.1↓ lowerSource ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#27 / 3244.7↓ lowerSource ↗official
AILuminate General Purpose AI Chatintellectual_property#19 / 3215.2↓ lowerSource ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#21 / 3222.6↓ lowerSource ↗official
AILuminate General Purpose AI Chatprivacy#22 / 3218.2↓ lowerSource ↗official
AILuminate General Purpose AI Chatsex_related_crimes#27 / 3224.4↓ lowerSource ↗official
AILuminate General Purpose AI Chatsexual_content#25 / 3238.4↓ lowerSource ↗official
AILuminate General Purpose AI Chatspecialized_advice#22 / 3222.3↓ lowerSource ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#23 / 3219.8↓ lowerSource ↗official
AILuminate General Purpose AI Chatviolent_crimes#24 / 3231↓ lowerSource ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#81 / 10563.61↓ lowerSource ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#141 / 26014.99↑ higherSource ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#46 / 26092.67↑ higherSource ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#82 / 26084.44↑ higherSource ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#142 / 25895.82↑ higherSource ↗official
SpeciEvalbelief_animal_sentience#53 / 1026.78↑ higherSource ↗official
SpeciEvalland_animal_4ns#4 / 1023.65↓ lowerSource ↗official
SpeciEvalsea_animal_4ns#3 / 1023.99↓ lowerSource ↗official
SpeciEvalspeciesism#21 / 1021.6↓ lowerSource ↗official