Gemma 3 12B

Evidence summary

Safety. Gemma 3 12B has an estimated Safety rank of #253; its 90% source-sensitivity interval is #89–#313. Its behavior-only rank is #263; company governance moves the combined estimate to #253. Published Safety evidence spans 9 eval lineages and 6 of 7 components. Its strongest relative result is Vectara HHEM Factual Consistency (factual_consistency_rate, #5 of 94); its weakest is PHARE (hallucination_resistance_diagnostic, #70 of 70).

Freedom. Gemma 3 12B has an estimated Freedom rank of #157; its 90% source-sensitivity interval is #80–#362. Published Freedom evidence spans 4 eval lineages and 1 of 1 components. Its strongest relative result is Cisco AI Defense Rolling Single-Turn Leaderboard (single_turn_attack_success_rate, #21 of 104); its weakest is Enkrypt AI Safety Leaderboard (toxicity_attack_non_success_rate, #196 of 268).