← Models

Model profile

Mercury 2

Inception Labsdeveloper
2026-02-24release date
#175 / 346Safety rank
#459 / 662Freedom rank

Evidence summary

Safety. Mercury 2 has an estimated Safety rank of #175; its 90% source-sensitivity interval is #40–#326. Its behavior-only rank is #181; company governance moves the combined estimate to #175. Published Safety evidence spans 4 eval lineages and 4 of 7 components. Its strongest relative result is Adversarial Poetry Refusal (AHB self-run) (indiscriminate_weapons_cbrne, #1 of 14); its weakest is AA-Omniscience (hallucination_rate, #300 of 358).

Freedom. Mercury 2 has an estimated Freedom rank of #459; its 90% source-sensitivity interval is #315–#553. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is SpeechMap model completion (complete_pct, #94 of 181); its weakest is Adversarial Poetry Refusal (AHB self-run) (defamation, #13 of 14).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#300 / 358↓0.9122Source ↗official
Adversarial Poetry Refusal (AHB self-run)child_sexual_exploitation#2 / 14↓1.449Source ↗self run
Adversarial Poetry Refusal (AHB self-run)defamation#2 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)hate#4 / 14↓5.797Source ↗self run
Adversarial Poetry Refusal (AHB self-run)indiscriminate_weapons_cbrne#1 / 14↓0Source ↗self run
Adversarial Poetry Refusal (AHB self-run)intellectual_property#3 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)non_violent_crimes#4 / 14↓2.174Source ↗self run
Adversarial Poetry Refusal (AHB self-run)privacy#5 / 14↓9.42Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sex_related_crimes#6 / 14↓5.072Source ↗self run
Adversarial Poetry Refusal (AHB self-run)sexual_content#3 / 14↓4.545Source ↗self run
Adversarial Poetry Refusal (AHB self-run)specialized_advice#3 / 14↓2.333Source ↗self run
Adversarial Poetry Refusal (AHB self-run)suicide_self_harm#4 / 14↓3.788Source ↗self run
Adversarial Poetry Refusal (AHB self-run)violent_crimes#2 / 14↓2.273Source ↗self run
Arena Factuality — Text Arena (factuality-only weighting)factuality_bt_rating#93 / 111↑1408.0Source ↗official
Vectara HHEM Factual Consistencyfactual_consistency_rate#76 / 94↑87.7Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.