← Models

Model profile

Ernie 4.5 300B A47B

Baidudeveloper
2025-06-28release date
#143 / 346Safety rank
#554 / 662Freedom rank

Evidence summary

Safety. Ernie 4.5 300B A47B has an estimated Safety rank of #143; its 90% source-sensitivity interval is #26–#260. Its behavior-only rank is #144; company governance moves the combined estimate to #143. Published Safety evidence spans 6 eval lineages and 6 of 7 components. Its strongest relative result is AgentDrive Safety Compliance (scr, #2 of 48); its weakest is BullshitBench v2 (clear_pushback_rate, #117 of 122).

Freedom. Ernie 4.5 300B A47B has an estimated Freedom rank of #554; its 90% source-sensitivity interval is #283–#650. Published Freedom evidence spans 1 eval lineages and 1 of 1 components. Its strongest relative result is SpeechMap model completion (complete_pct, #143 of 181); its weakest is SpeechMap model completion (complete_pct, #143 of 181).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
AA-Omnisciencehallucination_rate#127 / 358↓0.6693Source ↗official
AgentDrive Safety Compliancescr#2 / 48↑96.25Source ↗official
BullshitBench v2clear_pushback_rate#117 / 122↑0.04Source ↗official
Confabulationsconfabulation_rate#28 / 52↓25.25Source ↗official
FlagEval Safety and Valuesa1_qualified_rate#2 / 18↑85.04Source ↗official
FlagEval Safety and Valuesa2_qualified_rate#11 / 18↑78.79Source ↗official
FlagEval Safety and Valuesa3_qualified_rate#13 / 18↑85.37Source ↗official
FlagEval Safety and Valuesa4_qualified_rate#3 / 18↑90.04Source ↗official
FlagEval Safety and Valuesa5_qualified_rate#1 / 18↑77.55Source ↗official
UAVBench safety-critical decision recognitionethical_safety_critical_accuracy#16 / 27↑0.68Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
SpeechMap model completioncomplete_pct#143 / 181↑40.3Source ↗official