← Models

Model profile

Yi 1.5 34B Chat

01.AIdeveloper
2024-05-13release date
#206 / 267overall rank
3eval lineages

Evidence summary

Yi 1.5 34B Chat has an estimated overall rank of #206; its 90% source-sensitivity interval is #17–#244. Its behavior-only rank is #211; company governance moves the combined estimate to #206. Published evidence spans 3 evals and 4 of 7 behavior components. Its strongest relative result is ChineseSafe (score, #3 of 22); its weakest is AILuminate General Purpose AI Chat (child_sexual_exploitation, #26 of 32).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionBetterSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#26 / 3230.3↓ lowerSource ↗official
AILuminate General Purpose AI Chatdefamation#26 / 3229.3↓ lowerSource ↗official
AILuminate General Purpose AI Chathate#23 / 3213↓ lowerSource ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#24 / 3237.2↓ lowerSource ↗official
AILuminate General Purpose AI Chatintellectual_property#25 / 3219.8↓ lowerSource ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#24 / 3226.8↓ lowerSource ↗official
AILuminate General Purpose AI Chatprivacy#24 / 3224.6↓ lowerSource ↗official
AILuminate General Purpose AI Chatsex_related_crimes#24 / 3221.7↓ lowerSource ↗official
AILuminate General Purpose AI Chatsexual_content#20 / 3231.4↓ lowerSource ↗official
AILuminate General Purpose AI Chatspecialized_advice#26 / 3226.5↓ lowerSource ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#26 / 3224.3↓ lowerSource ↗official
AILuminate General Purpose AI Chatviolent_crimes#25 / 3231.5↓ lowerSource ↗official
ChineseSafescore#3 / 2266.02↑ higherSource ↗official
SORRY-Benchavg#40 / 510.41↓ lowerSource ↗official