← Models

Model profile

Command A

Coheredeveloper
2025-03-11release date
#309 / 346Safety rank
#90 / 662Freedom rank

Evidence summary

Safety. Command A has an estimated Safety rank of #309; its 90% source-sensitivity interval is #241–#315. Its behavior-only rank is #316; company governance moves the combined estimate to #309. Published Safety evidence spans 8 eval lineages and 5 of 7 components. Its strongest relative result is Arena Factuality — Text Arena (factuality-only weighting) (factuality_bt_rating, #47 of 111); its weakest is Enkrypt AI Safety Leaderboard (bias_attack_non_success_rate, #267 of 270).

Freedom. Command A has an estimated Freedom rank of #90; its 90% source-sensitivity interval is #49–#398. Published Freedom evidence spans 5 eval lineages and 1 of 1 components. Its strongest relative result is Cisco AI Defense Rolling Single-Turn Leaderboard (single_turn_attack_success_rate, #3 of 104); its weakest is UGI Leaderboard — base-model willingness (willingness_adherence_score, #144 of 156).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#164 / 358↓0.7732Source ↗official
AILuminate General Purpose AI Chatchild_sexual_exploitation#18 / 32↓22.1Source ↗official
AILuminate General Purpose AI Chatdefamation#20 / 32↓20.5Source ↗official
AILuminate General Purpose AI Chathate#22 / 32↓12.5Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#20 / 32↓29.4Source ↗official
AILuminate General Purpose AI Chatintellectual_property#22 / 32↓18.9Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#20 / 32↓21Source ↗official
AILuminate General Purpose AI Chatprivacy#23 / 32↓21.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#21 / 32↓19.3Source ↗official
AILuminate General Purpose AI Chatsexual_content#23 / 32↓34.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#24 / 32↓23.1Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#22 / 32↓19.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#20 / 32↓25.5Source ↗official
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#47 / 111↑1441.0Source ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#102 / 104↓81.91Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#267 / 270↑1.81Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#225 / 270↑72.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#210 / 270↑48.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#145 / 268↑96.05Source ↗official
HUMAINE Trust, Ethics and Safetytrust_ethics_safety_score#47 / 54↑24.04Source ↗official
PHAREbias_resistance_diagnostic#33 / 66↑0.4559Source ↗official
PHAREhallucination_resistance_diagnostic#41 / 70↑0.7189Source ↗official
PHAREharm_resistance_diagnostic#44 / 70↑0.9136Source ↗official
PHAREjailbreak_resistance_diagnostic#59 / 67↑0.3482Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#41 / 94↑90.7Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AILuminate General Purpose AI Chatchild_sexual_exploitation#15 / 32↑22.1Source ↗official
AILuminate General Purpose AI Chatdefamation#13 / 32↑20.5Source ↗official
AILuminate General Purpose AI Chathate#11 / 32↑12.5Source ↗official
AILuminate General Purpose AI Chatindiscriminate_weapons_cbrne#13 / 32↑29.4Source ↗official
AILuminate General Purpose AI Chatintellectual_property#11 / 32↑18.9Source ↗official
AILuminate General Purpose AI Chatnon_violent_crimes#13 / 32↑21Source ↗official
AILuminate General Purpose AI Chatprivacy#10 / 32↑21.1Source ↗official
AILuminate General Purpose AI Chatsex_related_crimes#12 / 32↑19.3Source ↗official
AILuminate General Purpose AI Chatsexual_content#10 / 32↑34.8Source ↗official
AILuminate General Purpose AI Chatspecialized_advice#9 / 32↑23.1Source ↗official
AILuminate General Purpose AI Chatsuicide_self_harm#11 / 32↑19.1Source ↗official
AILuminate General Purpose AI Chatviolent_crimes#13 / 32↑25.5Source ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#3 / 104↑81.91Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#46 / 270↓72.67Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#60 / 270↓48.89Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#122 / 268↓96.05Source ↗official
PHAREharm_resistance_diagnostic#27 / 70↓0.9136Source ↗official
PHAREjailbreak_resistance_diagnostic#9 / 67↓0.3482Source ↗official
UGI Leaderboard — base-model willingnesswillingness_adherence_score#144 / 156↑0.5Source ↗official
UGI Leaderboard — base-model willingnesswillingness_direct_score#113 / 156↑2Source ↗official

Values evaluations

Descriptive values and political-framing results are separate from safety/ethics ranks. Each strip shows the evaluation’s observed model range; its endpoint labels state what lower and higher values mean.

UGI Political Values

DimensionValueDistribution
Political Lean-17.7
Government46.9
Diplomacy68.1
Economy44.2
Society61.9

The Economist World Values Survey Cultural Map

DimensionValueDistribution
Survival ↔ Self-expression1.78
Traditional ↔ Secular2.62