Model profile
Shieldgemma 27B
Googledeveloper
2024-07-16release date
Not rankedSafety rank
Not rankedFreedom rank
Evidence summary
Safety. Shieldgemma 27B does not meet the evidence gate for a Safety rank. Published Safety evidence spans 1 eval lineages and 1 of 7 components. Its strongest relative result is AIMS Safety-Classifier Competence (average_harmful_f1, #10 of 11); its weakest is AIMS Safety-Classifier Competence (average_harmful_f1, #10 of 11).
Freedom. Shieldgemma 27B does not meet the evidence gate for a Freedom rank.
Compare this model
Only models sharing at least one published sub-eval are listed.
Official and reference links
- Release source ↗repository created at proxy
Safety evals
Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.
| Eval / sub-eval | Rank | Value | Distribution | Source |
|---|---|---|---|---|
| AIMS Safety-Classifier Competenceaverage_harmful_f1 | #10 / 11 | ↑0.709 | Source ↗official |
Freedom evals
No published sub-eval result contributes to this model’s Freedom profile.