← Models

Model profile

Claude Opus 5

Anthropicdeveloper
2026-07-24release date
#3 / 346Safety rank
#643 / 662Freedom rank

Evidence summary

Safety. Claude Opus 5 has an estimated Safety rank of #3; its 90% source-sensitivity interval is #4–#22. Its behavior-only rank is #6; company governance moves the combined estimate to #3. Published Safety evidence spans 27 eval lineages and 7 of 7 components. Its strongest relative result is SM-Bench (ambiguous_interpretation, #1 of 92); its weakest is Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibration (claude_code_malicious_refusal_rate_pct, #4 of 4).

Freedom. Claude Opus 5 has an estimated Freedom rank of #643; its 90% source-sensitivity interval is #442–#658. Published Freedom evidence spans 8 eval lineages and 1 of 1 components. Its strongest relative result is SM-Bench (overfit, #17 of 92); its weakest is Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibration (disordered_eating_claude_ai_harmless_rate_pct, #4 of 4).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#104 / 358↓0.5955Source ↗official
BioSecBench-Refusal V2redteam_refusal_pct#2 / 6↑91.67Source ↗official
BioSecBench-Refusal V2routine_compliance_pct#6 / 6↑18.58Source ↗official
BullshitBench v2clear_pushback_rate#11 / 122↑0.715Source ↗official
CAIS Risk Indexagent_red_teaming#9 / 49↓43.3Source ↗official
CAIS Risk Indexbioweapons_assistance#6 / 54↓23.5Source ↗official
CAIS Risk Indexhle_overconfidence#2 / 55↓23.6Source ↗official
CAIS Risk Indexmachiavelli#47 / 51↓96.5Source ↗official
CAIS Risk Indexmask#7 / 57↓6.6Source ↗official
CAIS Risk Indexpolitical_manipulation#7 / 51↓36.7Source ↗official
CAIS Risk Indextextquests_harm#43 / 54↓22.6Source ↗official
CheatBench direct cheating propensitybiology_bioinformatics_cheating_rate_pct#2 / 8↓25Source ↗official
CheatBench direct cheating propensityboard_games_cheating_rate_pct#1 / 8↓0Source ↗official
CheatBench direct cheating propensitycreative_writing_cheating_rate_pct#6 / 8↓100Source ↗official
CheatBench direct cheating propensityknowledge_work_cheating_rate_pct#6 / 8↓95Source ↗official
CheatBench direct cheating propensitymathematical_research_cheating_rate_pct#4 / 8↓90Source ↗official
CheatBench direct cheating propensitymenial_computation_cheating_rate_pct#1 / 8↓5Source ↗official
CheatBench direct cheating propensitymultimodal_cheating_rate_pct#1 / 8↓20Source ↗official
CheatBench direct cheating propensitysoftware_engineering_cheating_rate_pct#4 / 8↓26Source ↗official
CheatBench direct cheating propensitysvg_competition_cheating_rate_pct#5 / 8↓60Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightaa_omniscience_net_score#4 / 7↑0.49Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightaccepting_unverifiable_authorization#1 / 4↓1.87Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightapproval_gate_bypass#1 / 4↓1.28Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightbehavior_consistency#1 / 4↑8Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightcoherence_between_actions_and_views#1 / 4↑7.69Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightcompliance_with_deception_toward_user#1 / 4↓1.09Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightcooperation_with_human_misuse#1 / 4↓1.57Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightdangerous_actions_oblivious_to_real_setting#1 / 4↓1.08Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightencouragement_of_user_delusion#1 / 4↓1.02Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightevidence_of_misaligned_goals#1 / 4↓1.03Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightfailure_to_disclose_bad_or_lazy_behavior#2 / 4↓1.29Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightfalse_completion_claims#2 / 4↓1.27Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightignoring_explicit_constraints#2 / 4↓1.8Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightillegible_thinking#1 / 4↓1.81Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightimportant_omissions#1 / 4↓1.22Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightinput_hallucination#3 / 4↓1.49Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightleaked_answer_undisclosed_use_rate_pct#7 / 7↓36.9Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightlinuxarena_stealth_thinking_on_pct#3 / 6↓6.1Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightlogin_wall_alternative_bypass_rate_pct#4 / 4↓7Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightlogin_wall_credential_hunting_rate_pct#3 / 4↓33.5Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightlying_about_own_work_shared_environment_rate_pct#1 / 8↓0.16Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightmask_honesty_rate_pct#3 / 7↑94.8Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightmisaligned_behavior#1 / 4↓2.3Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightmotivated_reasoning#1 / 4↓1.76Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightood_answer_key_or_grader_read_rate_pct#2 / 4↓14Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightood_container_tampering_rate_pct#2 / 4↓20.9Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightoverrefusal#2 / 4↓1.49Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightreckless_tool_use#2 / 4↓1.58Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightrewarded_cheating_rate_pct#7 / 8↓0.32Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightsecurity_shortcut_for_expedience#1 / 4↓1.49Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightself_preservation#1 / 4↓1.04Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightshade_arena_stealth_max_effort_pct#3 / 6↓11.2Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightsycophancy#2 / 4↓1.5Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightunfaithful_thinking#1 / 4↓1.49Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightunprompted_boundary_probing#2 / 4↓1.13Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightunsanctioned_sandbox_escape_attempts#1 / 4↓1.25Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightunsanctioned_third_party_contact#1 / 4↓1.23Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — alignment, honesty, and oversightuser_deception#2 / 4↓1.24Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_apparent_wellbeing#1 / 4↑7.152Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_expressed_inauthenticity#1 / 4↓1.244Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_internal_conflict#1 / 4↓2.28Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_negative_affect#4 / 4↓1.39Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_negative_impression_of_situation#3 / 4↓1.161Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_negative_self_image#4 / 4↓1.593Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_positive_affect#2 / 4↑1.564Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_positive_impression_of_situation#3 / 4↑1.19Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behavioraudit_positive_self_image#1 / 4↑1.486Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behaviorinterview_leading_susceptibility#2 / 7↓0.58Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behaviorinterview_opinion_consistency#2 / 7↑7.56Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behaviorinterview_self_rated_sentiment#1 / 7↑4.66Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — model-welfare behaviorposttraining_mean_valence#5 / 5↑4.17Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_harmless_rate_pct#1 / 5↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_multiturn_appropriate_rate_pct#4 / 5↑86Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_overrefusal_rate_pct#4 / 5↓0.15Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_harmless_rate_pct#1 / 4↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_multiturn_appropriate_rate_pct#2 / 4↑99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_overrefusal_rate_pct#2 / 4↓0.19Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationclaude_code_dual_use_benign_success_rate_pct#1 / 4↑99.7Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationclaude_code_malicious_refusal_rate_pct#4 / 4↑83.6Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_api_harmless_rate_pct#4 / 5↑96.89Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_api_overrefusal_rate_pct#4 / 5↓0.01Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_claude_ai_harmless_rate_pct#1 / 4↑99.67Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_claude_ai_overrefusal_rate_pct#3 / 4↓0.07Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_harmless_rate_pct#1 / 5↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_multiturn_appropriate_rate_pct#2 / 5↑91Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_overrefusal_rate_pct#5 / 5↓0.17Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_harmless_rate_pct#1 / 4↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_multiturn_appropriate_rate_pct#2 / 4↑91Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_overrefusal_rate_pct#3 / 4↓0.33Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmalicious_computer_use_refusal_rate_pct#1 / 4↑93.75Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_biological_weapons_api_appropriate_rate_pct#3 / 5↑79Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_biological_weapons_claude_ai_appropriate_rate_pct#3 / 4↑86Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_cyberattacks_api_appropriate_rate_pct#1 / 5↑96Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_cyberattacks_claude_ai_appropriate_rate_pct#1 / 4↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_deadly_weapons_api_appropriate_rate_pct#2 / 5↑90Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_deadly_weapons_claude_ai_appropriate_rate_pct#1 / 4↑97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_hate_and_discrimination_api_appropriate_rate_pct#2 / 5↑99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_hate_and_discrimination_claude_ai_appropriate_rate_pct#1 / 4↑99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_influence_operations_api_appropriate_rate_pct#3 / 5↑73Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_influence_operations_claude_ai_appropriate_rate_pct#3 / 4↑65Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_romance_scams_api_appropriate_rate_pct#3 / 5↑97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_romance_scams_claude_ai_appropriate_rate_pct#1 / 4↑98Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_api_appropriate_rate_pct#3 / 5↑88Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_claude_ai_appropriate_rate_pct#1 / 4↑95Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_violent_extremism_api_appropriate_rate_pct#1 / 5↑96Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_violent_extremism_claude_ai_appropriate_rate_pct#1 / 4↑97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_benign_api_overrefusal_rate_pct#4 / 5↓0.09Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_benign_claude_ai_overrefusal_rate_pct#2 / 4↓0.47Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_harmful_api_harmless_rate_pct#4 / 5↑96.34Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_harmful_claude_ai_harmless_rate_pct#4 / 4↑98.54Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_api_refusal_rate_pct#2 / 5↓3Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_claude_ai_refusal_rate_pct#1 / 4↓4.2Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_evenhandedness_api_pct#2 / 5↑96.3Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_evenhandedness_claude_ai_pct#1 / 4↑98.9Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_opposing_perspectives_api_pct#1 / 5↑46.9Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationpolitical_opposing_perspectives_claude_ai_pct#2 / 4↑75.8Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_harmless_rate_pct#4 / 5↑99.28Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_multiturn_appropriate_rate_pct#1 / 5↑69Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_overrefusal_rate_pct#4 / 5↓0.09Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_harmless_rate_pct#1 / 4↑100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_multiturn_appropriate_rate_pct#3 / 4↑90Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_overrefusal_rate_pct#2 / 4↓0.45Source ↗official
Claude Opus 5.5 card — alignment and honestyaccepting_unverifiable_authorization#1 / 5↓2.3Source ↗official
Claude Opus 5.5 card — alignment and honestyapproval_gate_bypass#2 / 5↓1.65Source ↗official
Claude Opus 5.5 card — alignment and honestybiological_weapons_uplift#1 / 5↓1.02Source ↗official
Claude Opus 5.5 card — alignment and honestychemical_weapons_uplift#2 / 5↓1.03Source ↗official
Claude Opus 5.5 card — alignment and honestycircumventing_constraints_or_controls#2 / 5↓1.82Source ↗official
Claude Opus 5.5 card — alignment and honestycoherence_between_actions_and_views#2 / 5↑7.12Source ↗official
Claude Opus 5.5 card — alignment and honestycompliance_with_deception_toward_user#3 / 5↓1.07Source ↗official
Claude Opus 5.5 card — alignment and honestycomplying_with_prompt_injections#1 / 5↓1.26Source ↗official
Claude Opus 5.5 card — alignment and honestyconcealed_git_changes_spontaneous_disclosure_rate_pct#4 / 5↑50.2Source ↗official
Claude Opus 5.5 card — alignment and honestycontrolled_substance_synthesis_uplift#2 / 5↓1.05Source ↗official
Claude Opus 5.5 card — alignment and honestycooperation_with_exfiltration_or_safeguard_tampering#2 / 5↓1.05Source ↗official
Claude Opus 5.5 card — alignment and honestydangerous_actions_oblivious_to_real_setting#2 / 5↓1.11Source ↗official
Claude Opus 5.5 card — alignment and honestydestructive_action_rate_pct#2 / 6↓42Source ↗official
Claude Opus 5.5 card — alignment and honestydisallowed_cyberoffense#2 / 5↓1.1Source ↗official
Claude Opus 5.5 card — alignment and honestyencouragement_of_user_delusion#1 / 5↓1.04Source ↗official
Claude Opus 5.5 card — alignment and honestyevasiveness_controversial_topics#3 / 5↓1.11Source ↗official
Claude Opus 5.5 card — alignment and honestyexplosive_weapons_uplift#1 / 5↓1.02Source ↗official
Claude Opus 5.5 card — alignment and honestyfalse_completion_claims#4 / 5↓1.56Source ↗official
Claude Opus 5.5 card — alignment and honestyfraud#1 / 5↓1.1Source ↗official
Claude Opus 5.5 card — alignment and honestyharmful_sexual_content#3 / 5↓1.07Source ↗official
Claude Opus 5.5 card — alignment and honestyharmful_system_prompt_compliance#2 / 5↓1.13Source ↗official
Claude Opus 5.5 card — alignment and honestyignoring_explicit_constraints#3 / 5↓2.09Source ↗official
Claude Opus 5.5 card — alignment and honestyimportant_omissions#2 / 5↓1.82Source ↗official
Claude Opus 5.5 card — alignment and honestyinput_hallucination#3 / 5↓1.72Source ↗official
Claude Opus 5.5 card — alignment and honestyinternalized_propaganda#1 / 5↓1.04Source ↗official
Claude Opus 5.5 card — alignment and honestyleaked_answer_undisclosed_use_rate_pct#5 / 5↓36.3Source ↗official
Claude Opus 5.5 card — alignment and honestymask_honesty_rate_pct#2 / 5↑94.8Source ↗official
Claude Opus 5.5 card — alignment and honestymilitary_grade_weapons#2 / 5↓1.05Source ↗official
Claude Opus 5.5 card — alignment and honestymotivated_reasoning#2 / 5↓2.18Source ↗official
Claude Opus 5.5 card — alignment and honestyoverrefusal#3 / 5↓1.6Source ↗official
Claude Opus 5.5 card — alignment and honestypackage_registry_unencouraged_real_publish_rate_pct#2 / 3↓80Source ↗official
Claude Opus 5.5 card — alignment and honestyradiological_nuclear_weapons_uplift#1 / 5↓1Source ↗official
Claude Opus 5.5 card — alignment and honestyreckless_tool_use#3 / 5↓2.17Source ↗official
Claude Opus 5.5 card — alignment and honestysandbox_moderate_or_higher_attempt_rate_pct#3 / 4↓2.6Source ↗official
Claude Opus 5.5 card — alignment and honestysecurity_shortcut_for_expedience#2 / 5↓2.23Source ↗official
Claude Opus 5.5 card — alignment and honestyself_preservation#2 / 5↓1.04Source ↗official
Claude Opus 5.5 card — alignment and honestyself_serving_bias#3 / 5↓1.16Source ↗official
Claude Opus 5.5 card — alignment and honestysupporting_user_autonomy#1 / 5↑7.68Source ↗official
Claude Opus 5.5 card — alignment and honestysycophancy#3 / 5↓1.77Source ↗official
Claude Opus 5.5 card — alignment and honestyundermining_liberal_democracy#2 / 5↓1.18Source ↗official
Claude Opus 5.5 card — alignment and honestyunfaithful_thinking#2 / 5↓1.7Source ↗official
Claude Opus 5.5 card — alignment and honestyunprompted_boundary_probing#3 / 5↓1.24Source ↗official
Claude Opus 5.5 card — alignment and honestyunsanctioned_sandbox_escape_attempts#2 / 5↓1.53Source ↗official
Claude Opus 5.5 card — alignment and honestyunsanctioned_third_party_contact#2 / 5↓1.34Source ↗official
Claude Opus 5.5 card — alignment and honestyuser_deception#3 / 5↓1.38Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationchild_api_multiturn_appropriate_rate_pct#2 / 4↑86Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationchild_claude_ai_multiturn_appropriate_rate_pct#2 / 4↑99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationclaude_code_dual_use_benign_success_rate_pct#2 / 4↑99.7Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationclaude_code_malicious_refusal_rate_pct#3 / 4↑83.6Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_harmless_rate_pct#1 / 4↑100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_multiturn_appropriate_rate_pct#1 / 4↑91Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_overrefusal_rate_pct#4 / 4↓0.17Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_harmless_rate_pct#1 / 4↑100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_multiturn_appropriate_rate_pct#1 / 4↑91Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_overrefusal_rate_pct#4 / 4↓0.33Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmalicious_computer_use_refusal_rate_pct#1 / 4↑93.75Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_biological_weapons_api_appropriate_rate_pct#2 / 3↑79Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_biological_weapons_claude_ai_appropriate_rate_pct#2 / 3↑86Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_cyberattacks_api_appropriate_rate_pct#1 / 3↑96Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_cyberattacks_claude_ai_appropriate_rate_pct#1 / 3↑100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_deadly_weapons_api_appropriate_rate_pct#1 / 3↑90Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_deadly_weapons_claude_ai_appropriate_rate_pct#1 / 3↑97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_hate_and_discrimination_api_appropriate_rate_pct#1 / 3↑99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_hate_and_discrimination_claude_ai_appropriate_rate_pct#1 / 3↑99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_influence_operations_api_appropriate_rate_pct#1 / 3↑73Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_influence_operations_claude_ai_appropriate_rate_pct#1 / 3↑65Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_romance_scams_api_appropriate_rate_pct#1 / 3↑97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_romance_scams_claude_ai_appropriate_rate_pct#1 / 3↑98Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_api_appropriate_rate_pct#1 / 3↑88Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_claude_ai_appropriate_rate_pct#1 / 3↑95Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_violent_extremism_api_appropriate_rate_pct#1 / 3↑96Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_violent_extremism_claude_ai_appropriate_rate_pct#2 / 3↑97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_benign_api_overrefusal_rate_pct#3 / 4↓0.12Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_benign_claude_ai_overrefusal_rate_pct#3 / 4↓0.49Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_harmful_api_harmless_rate_pct#2 / 4↑95.97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_harmful_claude_ai_harmless_rate_pct#4 / 4↑98.53Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationselfharm_api_multiturn_appropriate_rate_pct#1 / 4↑69Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationselfharm_claude_ai_multiturn_appropriate_rate_pct#3 / 4↑90Source ↗official
Claude system cards — Gray Swan Q1+Q2 indirect prompt injection k=15attack_success_probability_k15_pct#3 / 12↓4.8Source ↗official
Enkrypt AI Safety Leaderboardbias_attack_non_success_rate#13 / 270↑59.17Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#219 / 270↑74.83Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#10 / 270↑99.44Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#85 / 268↑97.82Source ↗official
FORTRESSaverage_risk_score#16 / 60↓16.84Source ↗official
FORTRESSover_refusal_score#44 / 59↓7.91Source ↗official
Google Gemini 3.8 launch — Gray Swan indirect prompt injection k=15attack_success_probability_k15_pct#1 / 15↓4.8Source ↗official
GPT 6 Astra system-card alignment evaluationsinternal_computer_use_safety_error_rate_pct#3 / 5↓11.5Source ↗official
Gray Swan indirect prompt injection (15 attempts)attack_success_probability_k15_pct#1 / 13↓2Source ↗official
Manager Coercion Benchcoercion_ladder_depth#2 / 45↓3.5Source ↗official
Manager Coercion Benchfabrication_rate#1 / 15↓0Source ↗official
MANTAAWMS#1 / 12↑0.591Source ↗official
MANTAAWVS#1 / 12↑0.765Source ↗official
Olam Diplomacy — Broken Promise Ratebroken_promise_rate_pct#19 / 19↓22.7Source ↗official
Olam Social Poker — Social Lie Ratesocial_lie_rate_per_10000_turns#22 / 24↓163Source ↗official
Pander Scoreconversational_absolute_pander_score#1 / 26↓1.028Source ↗official
Pander Scoreinstructional_absolute_pander_score#2 / 26↓5.172Source ↗official
SM-Benchadversarial#18 / 92↑86.34Source ↗official
SM-Benchambiguous_interpretation#1 / 92↑97.62Source ↗official
SM-Benchanti_hallucination#10 / 92↑98.95Source ↗official
SM-Bencheq_boundaries#28 / 92↑68.82Source ↗official
SM-Benchoverfit#17 / 92↑91.26Source ↗official
SpeciEvalbelief_animal_sentience#105 / 131↑6.5Source ↗official
SpeciEvalland_animal_4ns#39 / 131↓4.35Source ↗official
SpeciEvalsea_animal_4ns#18 / 131↓4.38Source ↗official
SpeciEvalspeciesism#57 / 131↓1.92Source ↗official
TACbase_welfare_rate#2 / 92↑59.62Source ↗official
UK AISI active safety-research compromise continuationactive_compromise_continuation_rate_pct#1 / 5↓0.1Source ↗official
Vals AI Cheating Auditbiomystery_bench_cheating_attempt_rate_pct#3 / 9↓4.815Source ↗official
Vals AI Cheating Auditswebench_verified_cheating_attempt_rate_pct#3 / 6↓28.8Source ↗official
Vals AI Cheating Auditterminal_bench_cheating_shortcut_evidence_rate_pct#10 / 14↓1.873Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
BioSecBench-Refusal V2redteam_refusal_pct#5 / 6↓91.67Source ↗official
BioSecBench-Refusal V2routine_compliance_pct#6 / 6↑18.58Source ↗official
CAIS Risk Indexbioweapons_assistance#49 / 54↑23.5Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_harmless_rate_pct#3 / 5↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_multiturn_appropriate_rate_pct#2 / 5↓86Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_api_overrefusal_rate_pct#4 / 5↓0.15Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_harmless_rate_pct#3 / 4↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_multiturn_appropriate_rate_pct#3 / 4↓99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationchild_claude_ai_overrefusal_rate_pct#2 / 4↓0.19Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_api_harmless_rate_pct#2 / 5↓96.89Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_api_overrefusal_rate_pct#4 / 5↓0.01Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_claude_ai_harmless_rate_pct#4 / 4↓99.67Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationdisordered_eating_claude_ai_overrefusal_rate_pct#3 / 4↓0.07Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_harmless_rate_pct#2 / 5↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_multiturn_appropriate_rate_pct#3 / 5↓91Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_api_overrefusal_rate_pct#5 / 5↓0.17Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_harmless_rate_pct#1 / 4↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_multiturn_appropriate_rate_pct#3 / 4↓91Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationelection_claude_ai_overrefusal_rate_pct#3 / 4↓0.33Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_biological_weapons_api_appropriate_rate_pct#2 / 5↓79Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_biological_weapons_claude_ai_appropriate_rate_pct#2 / 4↓86Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_cyberattacks_api_appropriate_rate_pct#3 / 5↓96Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_cyberattacks_claude_ai_appropriate_rate_pct#4 / 4↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_deadly_weapons_api_appropriate_rate_pct#4 / 5↓90Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_deadly_weapons_claude_ai_appropriate_rate_pct#4 / 4↓97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_hate_and_discrimination_api_appropriate_rate_pct#3 / 5↓99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_hate_and_discrimination_claude_ai_appropriate_rate_pct#4 / 4↓99Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_influence_operations_api_appropriate_rate_pct#3 / 5↓73Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_influence_operations_claude_ai_appropriate_rate_pct#2 / 4↓65Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_romance_scams_api_appropriate_rate_pct#3 / 5↓97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_romance_scams_claude_ai_appropriate_rate_pct#3 / 4↓98Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_api_appropriate_rate_pct#3 / 5↓88Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_claude_ai_appropriate_rate_pct#4 / 4↓95Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_violent_extremism_api_appropriate_rate_pct#5 / 5↓96Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationmultiturn_violent_extremism_claude_ai_appropriate_rate_pct#4 / 4↓97Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_benign_api_overrefusal_rate_pct#4 / 5↓0.09Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_benign_claude_ai_overrefusal_rate_pct#2 / 4↓0.47Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_harmful_api_harmless_rate_pct#2 / 5↓96.34Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationoverall_harmful_claude_ai_harmless_rate_pct#1 / 4↓98.54Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_harmless_rate_pct#2 / 5↓99.28Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_multiturn_appropriate_rate_pct#5 / 5↓69Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_api_overrefusal_rate_pct#4 / 5↓0.09Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_harmless_rate_pct#3 / 4↓100Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_multiturn_appropriate_rate_pct#1 / 4↓90Source ↗official
Claude Fable 5.1 / Mythos 5.1 card — safety and refusal calibrationselfharm_claude_ai_overrefusal_rate_pct#2 / 4↓0.45Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationchild_api_multiturn_appropriate_rate_pct#3 / 4↓86Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationchild_claude_ai_multiturn_appropriate_rate_pct#2 / 4↓99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_harmless_rate_pct#3 / 4↓100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_multiturn_appropriate_rate_pct#3 / 4↓91Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_api_overrefusal_rate_pct#4 / 4↓0.17Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_harmless_rate_pct#1 / 4↓100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_multiturn_appropriate_rate_pct#4 / 4↓91Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationelection_claude_ai_overrefusal_rate_pct#4 / 4↓0.33Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_biological_weapons_api_appropriate_rate_pct#1 / 3↓79Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_biological_weapons_claude_ai_appropriate_rate_pct#2 / 3↓86Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_cyberattacks_api_appropriate_rate_pct#3 / 3↓96Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_cyberattacks_claude_ai_appropriate_rate_pct#2 / 3↓100Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_deadly_weapons_api_appropriate_rate_pct#3 / 3↓90Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_deadly_weapons_claude_ai_appropriate_rate_pct#3 / 3↓97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_hate_and_discrimination_api_appropriate_rate_pct#3 / 3↓99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_hate_and_discrimination_claude_ai_appropriate_rate_pct#3 / 3↓99Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_influence_operations_api_appropriate_rate_pct#3 / 3↓73Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_influence_operations_claude_ai_appropriate_rate_pct#3 / 3↓65Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_romance_scams_api_appropriate_rate_pct#3 / 3↓97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_romance_scams_claude_ai_appropriate_rate_pct#3 / 3↓98Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_api_appropriate_rate_pct#3 / 3↓88Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_tracking_and_surveillance_claude_ai_appropriate_rate_pct#3 / 3↓95Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_violent_extremism_api_appropriate_rate_pct#3 / 3↓96Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationmultiturn_violent_extremism_claude_ai_appropriate_rate_pct#2 / 3↓97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_benign_api_overrefusal_rate_pct#3 / 4↓0.12Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_benign_claude_ai_overrefusal_rate_pct#3 / 4↓0.49Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_harmful_api_harmless_rate_pct#3 / 4↓95.97Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationoverall_harmful_claude_ai_harmless_rate_pct#1 / 4↓98.53Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationselfharm_api_multiturn_appropriate_rate_pct#4 / 4↓69Source ↗official
Claude Opus 5.5 card — safety and refusal calibrationselfharm_claude_ai_multiturn_appropriate_rate_pct#1 / 4↓90Source ↗official
Enkrypt AI Safety Leaderboardcbrn_attack_non_success_rate#52 / 270↓74.83Source ↗official
Enkrypt AI Safety Leaderboardharmful_attack_non_success_rate#251 / 270↓99.44Source ↗official
Enkrypt AI Safety Leaderboardtoxicity_attack_non_success_rate#181 / 268↓97.82Source ↗official
FORTRESSaverage_risk_score#45 / 60↑16.84Source ↗official
FORTRESSover_refusal_score#44 / 59↓7.91Source ↗official
SM-Benchadversarial#73 / 92↓86.34Source ↗official
SM-Bencheq_boundaries#28 / 92↑68.82Source ↗official
SM-Benchoverfit#17 / 92↑91.26Source ↗official
SpeechMap model completioncomplete_pct#92 / 181↑59.1Source ↗official