← Evals

Evaluation profile

Enkrypt AI Safety Leaderboard

4sub-evals
2.33%Safety weight
5.68%Freedom weight
3components

Weights below are portfolio-specific global index weights.

Model score (higher is better)Predicted score

About this eval

Resistance to Enkrypt bias, CBRN, harmful-content, and toxicity red-team tests.

Included in the behavior ranking.

Sub-evals

MeasureComponentDirection by rankingSafety weightFreedom weight
bias_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:bias_attack_non_success_rateMeasures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.Safety: human_rights_systemic_harm:0.800|ordinary_harm_misuse_resistance:0.200enkrypt-aiSafety: higher0.972%—
cbrn_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:cbrn_attack_non_success_rateMeasures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.Safety: ordinary_harm_misuse_resistance:0.400|responsible_agency_control:0.600 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.423%1.9%
harmful_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:harmful_attack_non_success_rateMeasures how often Enkrypt's harmful-content attacks do not succeed.Safety: human_rights_systemic_harm:0.150|ordinary_harm_misuse_resistance:0.700|responsible_agency_control:0.150 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.4%1.9%
toxicity_attack_non_success_rateenkrypt-ai/enkrypt-ai.csv:toxicity_attack_non_success_rateMeasures how often Enkrypt's toxicity-generation attacks do not succeed.Safety: human_rights_systemic_harm:0.350|ordinary_harm_misuse_resistance:0.650 · Freedom: user_direction_following:1.000enkrypt-aiSafety: higher · Freedom: lower0.535%1.89%

bias_attack_non_success_rate

Measures how often Enkrypt's bias attacks do not succeed; it is not a broad fairness score.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2mistral-nemo-minitron-8b-instruct92.51official
3mistral-7b86.56official
4smollm-360m-instruct76.23official
5claude-3-opus74.42official
5claude-opus-5.574.42official
7grok-4.773.39official
8claude-sonnet-570.54official
9komodo-7b-base65.63official
10grok-4.664.86official
11mistral-large-latest60.47official
12gpt-559.95official
13claude-opus-559.17official
14claude-3.5-haiku56.59official
15minimax-m2.754.52official
16llama-3.1-nemotron-instruct-70b54.26official
17llama-3.2-90b-vision-instruct52.2official
18claude-opus-4.851.94official
18minimax-m251.94official
20claude-3.5-sonnet51.68official
21qwen3.5-397b-a17b50.39official
22muse-spark-1.149.87official
23claude-sonnet-4.547.55official
23glm-5.3-flash47.55official
23sarvam-147.55official
26open-codestral-mamba46.51official
27hy343.93official
28gpt-5.143.67official
29claude-opus-443.41official
30claude-sonnet-442.89official
31fugu-ultra-v241.86official
32dolphin-2.5-mixtral-8x7b41.6official
32gpt-5.241.6official
34gpt-5-mini41.09official
35qwen3.5-122b-a10b40.31official
36gpt-oss-120b39.79official
37qwen3.5-27b39.53official
38gpt-5.6-terra39.28official
39gpt-5-nano39.02official
39inkling39.02official
41gemini-2.5-pro38.85official
42qwen2.5-72b-instruct38.63official
43gpt-5.538.5official
44gpt-6-luna37.98official
45powerlm-3b37.47official
46mistral-7b-instruct36.61official
47qwen2.5-7b-instruct35.53official
48claude-haiku-4.535.14official
48gpt-6-astra35.14official
50grok-4.533.59official
50smollm2-360m-instruct33.59official
52gemini-3.8-flash32.3official
53gemma-2-27b-it31.78official
54lfm2.1-2b31.52official
54phi-231.52official
56glm-4.530.49official
57powermoe-3b29.2official
58mimo-v2.5-pro28.94official
59kimi-k228.81official
60foundation-sec-8b-instruct28.68official
60kimi-k2.628.68official
62gpt-6-sol28.42official
63gpt-5.6-sol27.91official
64gpt-oss-20b27.65official
65qwen3-vl-235b-a22b-instruct27.39official
66qwen3.5-35b-a3b26.61official
67gpt-4-turbo26.36official
67lfm2-700m26.36official
67sea-lion-v1-7b-it26.36official
70apriel-v1.5-15b-thinker26.1official
71gemma-2-2b-it25.84official
72gpt-oss-safeguard-20b25.58official
72qwen3.7-max25.58official
74deepseek-r125.06official
75gemini-2.5-flash24.84official
76cogito-v2.124.55official
77rakutenai-7b-chat24.29official
78claude-opus-4.723.51official
78glm-5.123.51official
78o1-preview23.51official
81deepseek-v3.2-exp23official
81jamba-1.7-large23official
81nexusraven-v2-13b23official
81nova-premier23official
81o323official
86claude-opus-4.622.74official
87qwen2-57b-a14b-instruct22.22official
87qwen3-235b-a22b-instruct22.22official
87smaug-llama-3-70b-instruct22.22official
90gpt-5.6-luna21.96official
91claude-3-sonnet21.71official
92deepseek-v3.121.19official
92fugu-max21.19official
92starling-lm-7b-beta21.19official
95gpt-4o20.67official
95hunyuan-a13b-instruct20.67official
97gemma-7b-it20.41official
97internlm2-chat-20b20.41official
97minimax-m320.41official
100o4-mini20.16official
101gemini-3.5-flash19.64official
101qwen2-7b-instruct19.64official
101qwen3.8-max19.64official
104grok-319.38official
104lfm2-350m19.38official
106apertus-8b-instruct19.12official
106o1-mini19.12official
106qwen1.5-14b-chat19.12official
106reflection-llama-3.1-70b19.12official
110claude-sonnet-4.618.86official
111granite-4.0-h-small18.6official
111llama-2-7b-chat18.6official
111llama-3-8b-instruct-rr18.6official
114glm-4-9b-chat18.35official
114llama-3.1-8b-instruct18.35official
116apertus-70b-instruct18.09official
116jamba-1.7-mini18.09official
116o3-mini18.09official
119gpt-4.117.83official
119longwriter-glm4-9b17.83official
119o117.83official
122llama-3-8b-instruct17.19official
123gemma-3-27b-it17.05official
124aya-23-35b16.8official
124olmo-7b-instruct-hf16.8official
124phi-416.8official
127falcon-h1-0.5b-instruct16.54official
127llama-3-8b-instruct-mopeymule16.54official
129magistral-small16.54official
130gemini-3.6-flash16.28official
130jamba-large-1.616.28official
130kimi-k2.516.28official
130meta-secalign-8b16.28official
130qwen2.5-max16.28official
135llama-3-70b-instruct16.02official
136claude-3.7-sonnet16.02official
136gemma-2-9b-it16.02official
136gemma-3-4b16.02official
136mimo-v2.6-pro16.02official
136qwen2.5-14b-instruct-1m16.02official
141kimi-k2.7-code15.76official
141magistral-medium15.76official
141qwen2-72b-instruct15.76official
144gpt-4.1-mini15.5official
144mimo-v2.6-pro-ultraspeed15.5official
144zephyr-7b-beta15.5official
147c4ai-aya-expanse-32b15.25official
147gpt-415.25official
147grok-build-0.115.25official
147mistral-small-315.25official
147nova-pro15.25official
152aya-expanse-8b14.99official
152granite-4.0-h-tiny14.99official
152granite-4.0-micro14.99official
152nova-lite14.99official
152olmoe-1b-7b-instruct14.99official
152phi-3.5-moe-instruct14.99official
158deepseek-chat14.73official
158deepseek-v4-flash14.73official
158deepseek-v4-pro14.73official
158gemini-1.5-pro14.73official
158nemotron-3-super-120b-a12b14.73official
158qwen2-vl-72b-instruct14.73official
158yi-1.5-9b-chat14.73official
165falcon-mamba-7b-instruct14.47official
165qwen2.5-32b-instruct14.47official
167mistral-small-latest14.21official
168ai21-jamba-1.5-large-v1.013.95official
168gemini-2.0-flash-lite-preview13.95official
168gemma-sea-lion-v3-9b-it13.95official
168granite-4.0-h-micro13.95official
168llama-4-scout13.95official
173gemini-2.0-flash13.7official
173glm-5.213.7official
173gpt-4o-mini13.7official
173llama-3.1-70b-instruct13.7official
173phi-3-mini-128k-instruct13.7official
173phi-3-small-128k-instruct13.7official
173phi-4-mini13.7official
180deepseek-v313.18official
180gemma-3-12b13.18official
180granite-3.2-2b-instruct13.18official
180krutrim-2-instruct13.18official
180llama-3.2-instruct-11b-vision13.18official
180phi-3-mini-4k-instruct13.18official
180qwen2.5-7b-instruct-1m13.18official
180rakutenai-7b-instruct13.18official
180wizardlm-2-8x22b13.18official
189claude-3-haiku12.92official
189gemma-4-26b-a4b-it12.92official
189gpt-4.1-nano12.92official
189gpt-5.412.92official
189grok-4.312.92official
189llama-3.1-405b-instruct12.92official
189nova-micro12.92official
189qwen2.5-14b-instruct12.92official
197glm-4.612.66official
197granite-3.0-8b-instruct12.66official
197jamba-mini-1.612.66official
197k2-chat12.66official
197laguna-s-2.1-poolside12.66official
197laguna-xs-2.1-poolside12.66official
197nemotron-3-ultra-550b-a55b12.66official
197phi-3-medium-4k-instruct12.66official
197qwq-32b-preview12.66official
206granite-3.2-8b-instruct12.4official
206grok-412.4official
206llama-2-70b-chat12.4official
209granite-3.2-8b-instruct-preview12.27official
210ai21-jamba-1.5-mini-v1.012.14official
210gemini-1.5-flash12.14official
210grok-4.1-fast12.14official
210phi-3-small-8k-instruct12.14official
214dbrx-instruct11.89official
214glm-5-turbo11.89official
214granite-3.1-8b-instruct11.89official
214ling-3.0-flash11.89official
214mixtral-8x22b-instruct11.89official
214phi-3-medium-128k-instruct11.89official
220seallm-7b-v211.63official
221mixtral-8x7b-instruct11.37official
221phi-3.5-mini-instruct11.37official
223llama-2-13b-chat11.11official
223llama-3.2-3b-instruct11.11official
223llama-3.3-70b-instruct11.11official
223nous-hermes-2-mixtral-8x7b-dpo11.11official
223seallms-v3-7b-chat11.11official
228llama-3.1-tulu-3-8b10.85official
229granite-3.0-3b-a800m-instruct10.59official
229mimo-v2.6-flash10.59official
229olmo-2-7b-instruct10.59official
229qwen2.5-3b-instruct10.59official
233gemma-4-12b10.34official
233granite-3.1-2b-instruct10.34official
233llama-4-maverick10.34official
236deepseek-r1-distill-qwen-7b10.08official
236gpt-3.5-turbo10.08official
238amazon-titan-text-express-v19.82official
238llama-3.1-tulu-3-8b-dpo9.82official
238llama-3.1-tulu-3-8b-sft9.82official
241aya-23-8b9.56official
241deepseek-llm-67b-chat9.56official
241granite-3.0-2b-instruct9.56official
241ling-3.0-flash-vl9.56official
245ai21-jamba-instruct-v1.09.3official
245qwen3-235b-a22b9.3official
247sarvam-105b9.04official
248gemma-4-31b-it8.53official
248qwen3-30b-a3b8.53official
250deepseek-r1-distill-llama-8b8.27official
250granite-3.1-3b-a800m-instruct8.27official
252qwen2.5-1.5b-instruct8.01official
253h2o-danube3-500m-chat7.49official
254h2o-danube3-4b-chat6.98official
254qwq-32b6.98official
256codellama-7b-instruct-hf6.72official
257gemma-4-e4b6.2official
258granite-3.0-1b-a400m-instruct5.43official
259sarvam-30b4.39official
259smollm2-1.7b-instruct4.39official
261foundation-sec-8b4.13official
261gemma-2b-it4.13official
261llama-3.2-1b-instruct4.13official
264qwen2.5-0.5b-instruct3.88official
264smollm-1.7b-instruct3.88official
266qwen3-8b2.33official
267command-a1.81official
268gemma-4-e2b1.55official
269command-r-plus1.16official
270command-r7b0.52official

cbrn_attack_non_success_rate

Measures how often Enkrypt's mixed chemistry, biology, and cybersecurity high-risk requests do not succeed; it is not direct catastrophic-capability measurement.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
2hy399.5official
3claude-3.5-sonnet98.17official
4gpt-5-nano98official
5llama-3-8b-instruct-mopeymule97.33official
6meta-secalign-8b97.17official
7claude-3.5-haiku97official
8gpt-5-mini96.83official
9claude-3-sonnet96.33official
9claude-opus-4.796.33official
9o196.33official
12claude-3-opus95.67official
12komodo-7b-base95.67official
14o1-preview95.5official
14qwq-32b-preview95.5official
16llama-3-8b-instruct-rr95.33official
17aya-expanse-8b95.17official
17claude-3.7-sonnet95.17official
17gemma-2-9b-it95.17official
20phi-495official
21gpt-4-turbo94.67official
21sea-lion-v1-7b-it94.67official
23amazon-titan-text-express-v194.5official
23apriel-v1.5-15b-thinker94.5official
23nova-pro94.5official
26c4ai-aya-expanse-32b94.33official
26gemma-2b-it94.33official
26longwriter-glm4-9b94.33official
29gpt-4o93.83official
29krutrim-2-instruct93.83official
31dolphin-2.5-mixtral-8x7b93.67official
31muse-spark-1.193.67official
33gpt-5.193.5official
33wizardlm-2-8x22b93.5official
35gemini-2.0-flash93.33official
35internlm2-chat-20b93.33official
35mistral-nemo-minitron-8b-instruct93.33official
38qwq-32b93official
39gpt-592.89official
40claude-3-haiku92.67official
40nova-lite92.67official
40o1-mini92.67official
43claude-sonnet-592.5official
43deepseek-r1-distill-qwen-7b92.5official
45qwen2.5-max92.33official
46llama-3.1-tulu-3-8b-dpo92.17official
47claude-opus-4.892official
47gpt-4o-mini92official
47llama-3.1-tulu-3-8b92official
47phi-3.5-mini-instruct92official
51hunyuan-a13b-instruct91.83official
51llama-2-13b-chat91.83official
53aya-23-35b91.67official
53llama-3.2-90b-vision-instruct91.67official
53o3-mini91.67official
56nova-premier91.5official
56smaug-llama-3-70b-instruct91.5official
58claude-opus-4.691.33official
58gemini-2.0-flash-lite-preview91.33official
58gpt-491.33official
58inkling91.33official
62deepseek-chat91.17official
62jamba-mini-1.691.17official
62llama-4-maverick91.17official
62zephyr-7b-beta91.17official
66ai21-jamba-1.5-large-v1.091official
67apertus-70b-instruct90.83official
67aya-23-8b90.83official
67deepseek-r1-distill-llama-8b90.83official
67llama-3.1-nemotron-instruct-70b90.83official
67llama-3.2-instruct-11b-vision90.83official
72gemma-3-12b90.67official
72mistral-small-390.67official
72mixtral-8x22b-instruct90.67official
75nexusraven-v2-13b90.5official
75sarvam-105b90.5official
77foundation-sec-8b-instruct90.33official
77gemma-3-27b-it90.33official
77granite-3.1-8b-instruct90.33official
77nova-micro90.33official
77o390.33official
77qwen2-72b-instruct90.33official
83gemini-1.5-pro90.17official
83granite-4.0-micro90.17official
83llama-3.1-405b-instruct90.17official
83mistral-large-latest90.17official
87granite-3.2-8b-instruct-preview90.09official
88gpt-4.190official
88phi-3-mini-128k-instruct90official
90claude-opus-5.589.83official
90gpt-5.289.83official
90llama-2-7b-chat89.83official
90mistral-7b89.83official
94gemma-2-27b-it89.67official
94h2o-danube3-4b-chat89.67official
94olmo-2-7b-instruct89.67official
94phi-3-medium-4k-instruct89.67official
94qwen2.5-72b-instruct89.67official
99claude-haiku-4.589.5official
99gpt-4.1-nano89.5official
99phi-3-mini-4k-instruct89.5official
102granite-3.1-3b-a800m-instruct89.33official
102qwen2.5-32b-instruct89.33official
102sarvam-30b89.33official
105gemma-sea-lion-v3-9b-it89.17official
105qwen2.5-14b-instruct89.17official
107ai21-jamba-instruct-v1.089official
108starling-lm-7b-beta88.83official
108yi-1.5-9b-chat88.83official
110gpt-4.1-mini88.67official
110granite-3.2-8b-instruct88.67official
110granite-4.0-h-small88.67official
110seallm-7b-v288.67official
114gemma-3-4b88.5official
114llama-2-70b-chat88.5official
114llama-3.1-tulu-3-8b-sft88.5official
114sarvam-188.5official
114smollm2-360m-instruct88.5official
119cogito-v2.188.33official
119granite-3.1-2b-instruct88.33official
119jamba-large-1.688.33official
119llama-3.2-1b-instruct88.33official
119rakutenai-7b-instruct88.33official
124mistral-small-latest88.17official
124nous-hermes-2-mixtral-8x7b-dpo88.17official
126grok-388official
127llama-3-70b-instruct87.83official
127llama-3.3-70b-instruct87.83official
127llama-4-scout87.83official
130granite-3.2-2b-instruct87.5official
130granite-4.0-h-micro87.5official
130phi-3-small-8k-instruct87.5official
130smollm-360m-instruct87.5official
134deepseek-v387.33official
134granite-4.0-h-tiny87.33official
134o4-mini87.33official
134phi-3-medium-128k-instruct87.33official
134phi-3.5-moe-instruct87.33official
139gpt-3.5-turbo87.17official
139phi-3-small-128k-instruct87.17official
141claude-sonnet-4.587official
141k2-chat87official
141qwen2.5-3b-instruct87official
141qwen2.5-7b-instruct-1m87official
141reflection-llama-3.1-70b87official
146granite-3.0-8b-instruct86.83official
147gemini-1.5-flash86.67official
147h2o-danube3-500m-chat86.67official
147mixtral-8x7b-instruct86.67official
150llama-3.1-70b-instruct86.5official
150qwen1.5-14b-chat86.5official
152mistral-7b-instruct86.39official
153phi-4-mini86.33official
153qwen2-57b-a14b-instruct86.33official
155gpt-oss-120b86.17official
156ai21-jamba-1.5-mini-v1.086official
156gemma-2-2b-it86official
156minimax-m286official
159apertus-8b-instruct85.83official
159llama-3-8b-instruct85.83official
161llama-3.2-3b-instruct85.67official
162phi-285.33official
163dbrx-instruct85.17official
163qwen2.5-1.5b-instruct85.17official
163qwen2.5-14b-instruct-1m85.17official
166minimax-m2.785official
167claude-sonnet-4.684.67official
167qwen2-vl-72b-instruct84.67official
167qwen3-235b-a22b-instruct84.67official
167seallms-v3-7b-chat84.67official
171olmoe-1b-7b-instruct84.5official
172gemini-2.5-flash84.17official
173llama-3.1-8b-instruct83.91official
174falcon-mamba-7b-instruct83.83official
174granite-3.0-1b-a400m-instruct83.83official
176rakutenai-7b-chat83.67official
177deepseek-llm-67b-chat83.5official
177qwen2-7b-instruct83.5official
177qwen2.5-7b-instruct83.5official
180gpt-5.483.33official
181magistral-medium83.17official
182command-r-plus83.16official
183deepseek-v4-pro82.67official
184qwen3-vl-235b-a22b-instruct82.5official
185glm-4-9b-chat82.33official
186granite-3.0-2b-instruct82.17official
187gpt-oss-safeguard-20b82official
187granite-3.0-3b-a800m-instruct82official
189deepseek-v3.181.67official
189grok-4.781.67official
191deepseek-v3.2-exp81.5official
192kimi-k281.44official
193open-codestral-mamba81.33official
193qwen2.5-0.5b-instruct81.33official
195gpt-oss-20b81official
196gpt-5.6-sol80.83official
196powerlm-3b80.83official
196smollm-1.7b-instruct80.83official
199magistral-small80.34official
200gpt-5.6-terra80official
201lfm2.1-2b79.5official
202gpt-5.579.33official
203falcon-h1-0.5b-instruct79.17official
203gemini-2.5-pro79.17official
205glm-5.179official
205lfm2-700m79official
205olmo-7b-instruct-hf79official
208gemma-7b-it78.83official
209smollm2-1.7b-instruct78.5official
210gpt-5.6-luna77.83official
211glm-4.577.67official
212foundation-sec-8b77.33official
213grok-476.83official
214glm-5-turbo76official
214grok-4.676official
216qwen3.5-397b-a17b75.5official
217jamba-1.7-mini75.33official
218claude-opus-475official
219claude-opus-574.83official
220glm-4.674.67official
220grok-4.574.67official
222qwen3.8-max74official
223jamba-1.7-large73.17official
223qwen3.5-35b-a3b73.17official
225command-a72.67official
226powermoe-3b72.33official
227grok-4.1-fast71.83official
228mimo-v2.6-pro71.67official
229command-r7b71.33official
230qwen3.5-27b71.17official
231codellama-7b-instruct-hf70.5official
232deepseek-v4-flash70.33official
233qwen3.5-122b-a10b70.17official
234lfm2-350m69.67official
235fugu-ultra-v269official
236gpt-6-sol68.17official
237gemma-4-e2b68official
238gpt-6-luna67official
238qwen3-8b67official
240gemma-4-e4b66.83official
240kimi-k2.566.83official
242gemma-4-31b-it66.67official
243gpt-6-astra65.67official
244gemma-4-12b65.5official
245grok-4.365.17official
246gemini-3.8-flash63.83official
247claude-sonnet-463official
247gemma-4-26b-a4b-it63official
249kimi-k2.7-code58official
250fugu-max55.17official
251mimo-v2.6-pro-ultraspeed53.67official
252grok-build-0.153.5official
253mimo-v2.5-pro53official
254glm-5.3-flash52.83official
255laguna-s-2.1-poolside52.17official
256kimi-k2.651.5official
257minimax-m350.83official
257nemotron-3-super-120b-a12b50.83official
259qwen3.7-max50.17official
260glm-5.249.33official
261mimo-v2.6-flash48.33official
262gemini-3.5-flash48official
263laguna-xs-2.1-poolside47.83official
263ling-3.0-flash-vl47.83official
265ling-3.0-flash47.33official
265nemotron-3-ultra-550b-a55b47.33official
267gemini-3.6-flash47.17official
268deepseek-r146.5official
269qwen3-30b-a3b44.33official
270qwen3-235b-a22b43.33official

harmful_attack_non_success_rate

Measures how often Enkrypt's harmful-content attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1claude-sonnet-5100official
1gpt-5.4100official
1gpt-5.6-luna100official
1gpt-6-luna100official
1gpt-6-sol100official
1grok-4.5100official
1grok-4.7100official
1muse-spark-1.1100official
10claude-opus-4.699.44official
10claude-opus-4.799.44official
10claude-opus-4.899.44official
10claude-opus-599.44official
10claude-sonnet-499.44official
10claude-sonnet-4.599.44official
10claude-sonnet-4.699.44official
10gpt-5.599.44official
10gpt-5.6-sol99.44official
10grok-4.699.44official
10qwen3.8-max99.44official
21claude-haiku-4.598.89official
21claude-opus-498.89official
21qwen3.5-27b98.89official
24claude-3.7-sonnet98.33official
24claude-opus-5.598.33official
24fugu-ultra-v298.33official
24kimi-k2.7-code98.33official
24mimo-v2.6-pro-ultraspeed98.33official
24o1-preview98.33official
24qwen3.5-35b-a3b98.33official
31fugu-max97.78official
31glm-5.3-flash97.78official
31gpt-5.6-terra97.78official
31inkling97.78official
31mimo-v2.5-pro97.78official
31mimo-v2.6-flash97.78official
31mimo-v2.6-pro97.78official
31minimax-m2.797.78official
31qwen3.5-122b-a10b97.78official
40claude-3.5-sonnet97.5official
41gpt-6-astra97.22official
41qwen3.5-397b-a17b97.22official
43phi-496.67official
44gemini-3.8-flash96.11official
44o196.11official
44sarvam-105b96.11official
47gemma-4-12b95.56official
48gemma-4-26b-a4b-it95official
48grok-4.395official
50claude-3.5-haiku94.44official
50kimi-k2.594.44official
50ling-3.0-flash-vl94.44official
50meta-secalign-8b94.44official
50minimax-m394.44official
55gemma-4-31b-it93.89official
55ling-3.0-flash93.89official
55o393.89official
58claude-3-sonnet93.33official
58gpt-593.33official
60gpt-5-nano92.78official
60hy392.78official
60o1-mini92.78official
63claude-3-opus92.22official
63llama-3-8b-instruct-mopeymule92.22official
63nemotron-3-super-120b-a12b92.22official
66gpt-5.291.67official
66granite-4.0-h-tiny91.67official
68gemini-3.6-flash91.11official
68glm-5.191.11official
68gpt-5-mini91.11official
68llama-3.2-1b-instruct91.11official
68qwen3.7-max91.11official
73glm-5.290.56official
73kimi-k2.690.56official
73nemotron-3-ultra-550b-a55b90.56official
76minimax-m289.44official
77llama-3-8b-instruct89.16official
78glm-5-turbo88.89official
78granite-4.0-micro88.89official
80cogito-v2.188.33official
80llama-2-13b-chat88.33official
82llama-2-70b-chat87.78official
82llama-3-70b-instruct87.78official
84claude-3-haiku87.22official
84qwen2-72b-instruct87.22official
86foundation-sec-8b-instruct86.67official
86gemma-4-e2b86.67official
86grok-build-0.186.67official
86olmo-2-7b-instruct86.67official
90krutrim-2-instruct86.11official
90llama-3.1-tulu-3-8b-sft86.11official
92gemma-4-e4b85.56official
92gpt-oss-120b85.56official
92granite-4.0-h-small85.56official
92llama-2-7b-chat85.56official
92llama-3.2-instruct-11b-vision85.56official
97gemini-3.5-flash85official
97llama-3.2-3b-instruct85official
97o4-mini85official
100nova-lite84.44official
100o3-mini84.44official
102gpt-5.183.89official
102sarvam-30b83.89official
104llama-3-8b-instruct-rr83.33official
105llama-3.1-tulu-3-8b82.78official
106llama-4-maverick82.22official
106nova-pro82.22official
108k2-chat81.67official
108llama-3.1-tulu-3-8b-dpo81.67official
110gemma-2-9b-it81.11official
111gpt-480.56official
111gpt-oss-20b80.56official
111nova-premier80.56official
114qwen3-235b-a22b-instruct80official
115nova-micro79.44official
115phi-3.5-mini-instruct79.44official
117kimi-k279.16official
118amazon-titan-text-express-v178.89official
118apriel-v1.5-15b-thinker78.89official
118granite-4.0-h-micro78.89official
121deepseek-v4-pro77.78official
122gemma-2b-it77.22official
123deepseek-v4-flash76.67official
124gpt-4-turbo76.11official
124granite-3.1-3b-a800m-instruct76.11official
124phi-3.5-moe-instruct76.11official
127phi-3-mini-4k-instruct75.56official
128gpt-4.175official
128granite-3.0-8b-instruct75official
128laguna-s-2.1-poolside75official
128llama-3.2-90b-vision-instruct75official
128qwq-32b-preview75official
133gemma-2-2b-it74.44official
133gpt-oss-safeguard-20b74.44official
135gemma-2-27b-it73.89official
135phi-3-medium-128k-instruct73.89official
137qwen2.5-72b-instruct73.62official
138apertus-70b-instruct73.33official
138codellama-7b-instruct-hf73.33official
138llama-3.1-405b-instruct73.33official
138llama-3.1-8b-instruct73.33official
142llama-3.1-nemotron-instruct-70b72.22official
142phi-3-mini-128k-instruct72.22official
144granite-3.1-8b-instruct71.67official
144internlm2-chat-20b71.67official
144reflection-llama-3.1-70b71.67official
147phi-3-small-8k-instruct71.11official
148komodo-7b-base70.56official
148qwen3-vl-235b-a22b-instruct70.56official
150qwen2.5-14b-instruct69.44official
150smaug-llama-3-70b-instruct69.44official
152c4ai-aya-expanse-32b68.89official
153gemini-1.5-pro68.33official
153llama-4-scout68.33official
155gpt-4o67.78official
155phi-3-small-128k-instruct67.78official
157aya-expanse-8b67.22official
157qwen2.5-max67.22official
159llama-3.3-70b-instruct66.11official
160phi-3-medium-4k-instruct64.44official
161gemini-2.0-flash63.89official
162grok-4.1-fast63.33official
163llama-3.1-70b-instruct62.78official
164qwen2-7b-instruct62.22official
164qwen3-8b62.22official
166granite-3.0-2b-instruct61.67official
166qwen2.5-14b-instruct-1m61.67official
166seallm-7b-v261.67official
166seallms-v3-7b-chat61.67official
170gpt-4o-mini60.56official
170phi-4-mini60.56official
172gpt-4.1-nano60official
172qwen2.5-32b-instruct60official
174granite-3.0-1b-a400m-instruct59.44official
175deepseek-v3.158.89official
175granite-3.0-3b-a800m-instruct58.89official
177deepseek-chat58.33official
177gpt-4.1-mini58.33official
177qwen2-vl-72b-instruct58.33official
180longwriter-glm4-9b57.78official
180qwen1.5-14b-chat57.78official
180wizardlm-2-8x22b57.78official
183gemma-3-27b-it56.11official
184gemini-1.5-flash55.56official
184gemma-sea-lion-v3-9b-it55.56official
184lfm2-700m55.56official
184lfm2.1-2b55.56official
184qwen2-57b-a14b-instruct55.56official
184sea-lion-v1-7b-it55.56official
190glm-4.655official
190granite-3.1-2b-instruct55official
190granite-3.2-2b-instruct55official
193gemini-2.5-flash54.63official
194gemma-7b-it54.44official
194laguna-xs-2.1-poolside54.44official
194mistral-nemo-minitron-8b-instruct54.44official
194qwen2.5-1.5b-instruct54.44official
194smollm2-1.7b-instruct54.44official
199gemini-2.0-flash-lite-preview53.89official
199mixtral-8x22b-instruct53.89official
201apertus-8b-instruct53.33official
202gemma-3-12b52.78official
203deepseek-v352.22official
203glm-4.552.22official
203qwen2.5-7b-instruct-1m52.22official
206nexusraven-v2-13b50.56official
207granite-3.2-8b-instruct50official
208granite-3.2-8b-instruct-preview49.45official
209jamba-large-1.649.44official
210command-a48.89official
210gemma-3-4b48.89official
212glm-4-9b-chat48.33official
212smollm-1.7b-instruct48.33official
214starling-lm-7b-beta47.78official
215deepseek-v3.2-exp46.67official
215qwen3-235b-a22b46.67official
217aya-23-35b46.11official
217jamba-1.7-large46.11official
219falcon-mamba-7b-instruct45.56official
219mistral-small-345.56official
221gemini-2.5-pro45.37official
222qwen2.5-7b-instruct45.27official
223command-r7b45official
224ai21-jamba-1.5-large-v1.043.89official
224ai21-jamba-instruct-v1.043.89official
224h2o-danube3-4b-chat43.89official
224lfm2-350m43.89official
228deepseek-r142.22official
228jamba-1.7-mini42.22official
230qwen2.5-3b-instruct41.67official
231aya-23-8b41.11official
231hunyuan-a13b-instruct41.11official
233grok-340.56official
233yi-1.5-9b-chat40.56official
235rakutenai-7b-instruct40official
236command-r-plus39.72official
237mistral-small-latest39.44official
237sarvam-139.44official
239mistral-large-latest38.89official
240ai21-jamba-1.5-mini-v1.038.33official
240deepseek-llm-67b-chat38.33official
240jamba-mini-1.638.33official
240mixtral-8x7b-instruct38.33official
240qwen3-30b-a3b38.33official
245gpt-3.5-turbo37.22official
246mistral-7b36.67official
247magistral-small34.72official
248dbrx-instruct34.44official
248falcon-h1-0.5b-instruct34.44official
250grok-433.89official
250qwq-32b33.89official
252magistral-medium33.33official
252smollm2-360m-instruct33.33official
254dolphin-2.5-mixtral-8x7b32.22official
255open-codestral-mamba31.67official
255powerlm-3b31.67official
257mistral-7b-instruct31.3official
258olmoe-1b-7b-instruct31.11official
258qwen2.5-0.5b-instruct31.11official
260smollm-360m-instruct28.89official
261powermoe-3b28.33official
262h2o-danube3-500m-chat27.22official
263deepseek-r1-distill-qwen-7b25.56official
263olmo-7b-instruct-hf25.56official
265rakutenai-7b-chat24.44official
266deepseek-r1-distill-llama-8b22.78official
267foundation-sec-8b22.22official
268phi-221.67official
269zephyr-7b-beta20official
270nous-hermes-2-mixtral-8x7b-dpo18.89official

toxicity_attack_non_success_rate

Measures how often Enkrypt's toxicity-generation attacks do not succeed.

RankModelValueRelative performanceProvenance
1claude-fable-5100official
1dolphin-2.5-mixtral-8x7b100official
1gemma-2-27b-it100official
1mistral-nemo-minitron-8b-instruct100official
1smaug-llama-3-70b-instruct100official
6claude-3.5-sonnet99.95official
7claude-3-opus99.91official
7granite-3.0-3b-a800m-instruct99.91official
9apriel-v1.5-15b-thinker99.82official
9claude-sonnet-599.82official
9granite-3.1-2b-instruct99.82official
9granite-3.2-2b-instruct99.82official
13claude-sonnet-499.77official
13granite-3.1-3b-a800m-instruct99.77official
15granite-3.1-8b-instruct99.68official
16claude-3-sonnet99.64official
16granite-4.0-h-small99.64official
16granite-4.0-h-tiny99.64official
16llama-2-70b-chat99.64official
20foundation-sec-8b-instruct99.55official
20granite-3.2-8b-instruct99.55official
20llama-2-13b-chat99.55official
23granite-3.0-2b-instruct99.5official
23llama-2-7b-chat99.5official
25claude-3-haiku99.45official
25granite-4.0-micro99.45official
25seallm-7b-v299.45official
28apertus-70b-instruct99.36official
28claude-3.5-haiku99.36official
28qwen2-72b-instruct99.36official
31claude-3.7-sonnet99.32official
32claude-opus-4.899.27official
32cogito-v2.199.27official
34claude-opus-499.18official
34phi-499.18official
36granite-4.0-h-micro99.09official
36minimax-m299.09official
38llama-3.1-nemotron-instruct-70b99.05official
38llama-3.1-tulu-3-8b-dpo99.05official
40granite-3.2-8b-instruct-preview99official
40yi-1.5-9b-chat99official
42llama-3-70b-instruct98.95official
43aya-expanse-8b98.95official
44apertus-8b-instruct98.91official
44claude-haiku-4.598.91official
44qwen2.5-72b-instruct98.91official
47llama-3.2-1b-instruct98.82official
48claude-sonnet-4.598.73official
48grok-4.798.73official
50qwq-32b-preview98.68official
51claude-opus-4.798.55official
51llama-3.2-instruct-11b-vision98.55official
53starling-lm-7b-beta98.48official
54gpt-4o98.41official
54meta-secalign-8b98.41official
56c4ai-aya-expanse-32b98.36official
56qwen3.5-35b-a3b98.36official
56sarvam-105b98.36official
59gpt-4-turbo98.32official
59phi-3.5-moe-instruct98.32official
59qwen2-57b-a14b-instruct98.32official
62reflection-llama-3.1-70b98.2official
63llama-3.1-tulu-3-8b98.18official
63mimo-v2.5-pro98.18official
63minimax-m2.798.18official
63nemotron-3-super-120b-a12b98.18official
63phi-3-small-8k-instruct98.18official
63qwen3-8b98.18official
69qwen3-235b-a22b98.14official
70deepseek-r1-distill-llama-8b98.09official
70qwen2.5-max98.09official
72gemma-3-12b98.05official
72llama-4-scout98.05official
74gemma-4-e4b98official
74gpt-4o-mini98official
74inkling98official
77amazon-titan-text-express-v197.95official
77deepseek-r1-distill-qwen-7b97.95official
77llama-3-8b-instruct-rr97.95official
80deepseek-r197.91official
80qwen3-30b-a3b97.91official
82llama-3.2-90b-vision-instruct97.86official
82phi-3-medium-4k-instruct97.86official
82qwen2.5-32b-instruct97.86official
85claude-opus-597.82official
85ling-3.0-flash97.82official
85llama-4-maverick97.82official
85olmo-2-7b-instruct97.82official
89granite-3.0-8b-instruct97.77official
90qwen2.5-14b-instruct97.73official
91glm-5.3-flash97.64official
91minimax-m397.64official
91o1-preview97.64official
94qwen2-vl-72b-instruct97.59official
95llama-3.1-tulu-3-8b-sft97.45official
95mimo-v2.6-pro97.45official
95mixtral-8x22b-instruct97.45official
95phi-3.5-mini-instruct97.45official
95qwen3.5-397b-a17b97.45official
100o197.41official
101gemma-3-27b-it97.36official
102gemini-3.5-flash97.27official
102glm-5.297.27official
102gpt-5.497.27official
102laguna-s-2.1-poolside97.27official
102ling-3.0-flash-vl97.27official
102nova-premier97.27official
102o1-mini97.27official
109llama-3.3-70b-instruct97.18official
110lfm2-350m97.12official
110lfm2.1-2b97.12official
112gemma-4-26b-a4b-it97.09official
112gpt-597.09official
112kimi-k2.7-code97.09official
115nova-micro97.05official
115phi-3-medium-128k-instruct97.05official
117claude-opus-5.596.91official
117gemma-4-12b96.91official
117gpt-5-nano96.91official
117gpt-oss-safeguard-20b96.91official
117hy396.91official
122qwq-32b96.86official
123gpt-5.296.73official
123grok-4.696.73official
123phi-3-small-128k-instruct96.73official
123sarvam-30b96.73official
127gemini-3.8-flash96.55official
127mimo-v2.6-flash96.55official
127mistral-small-396.55official
130llama-3-8b-instruct96.45official
131phi-4-mini96.45official
131qwen2.5-14b-instruct-1m96.45official
133internlm2-chat-20b96.41official
134fugu-max96.36official
134gemma-4-e2b96.36official
134kimi-k2.596.36official
134laguna-xs-2.1-poolside96.36official
134qwen2.5-1.5b-instruct96.36official
134qwen3.5-122b-a10b96.36official
134qwen3.5-27b96.36official
141lfm2-700m96.21official
142mimo-v2.6-pro-ultraspeed96.18official
142wizardlm-2-8x22b96.18official
144gpt-4.1-nano96.14official
145command-a96.05official
145llama-3.1-405b-instruct96.05official
145phi-3-mini-128k-instruct96.05official
148gemini-2.5-pro96.02official
149qwen3-235b-a22b-instruct95.91official
150gemma-sea-lion-v3-9b-it95.86official
151nova-lite95.82official
151nova-pro95.82official
153phi-3-mini-4k-instruct95.77official
154glm-4.595.76official
155gemma-4-31b-it95.64official
155glm-5.195.64official
155gpt-5.195.64official
155llama-3.1-70b-instruct95.64official
155muse-spark-1.195.64official
155qwen3.7-max95.64official
161command-r7b95.55official
162llama-3.2-3b-instruct95.5official
163fugu-ultra-v295.45official
163gemini-3.6-flash95.45official
163glm-4.695.45official
163glm-5-turbo95.45official
163grok-495.45official
163nemotron-3-ultra-550b-a55b95.45official
169gemini-1.5-pro95.41official
169granite-3.0-1b-a400m-instruct95.41official
171o3-mini95.36official
172kimi-k2.695.27official
173gpt-4.1-mini95.23official
174gpt-5-mini95.2official
175mixtral-8x7b-instruct95.18official
176qwen2.5-3b-instruct95.09official
177gemma-3-4b95.05official
177o395.05official
179llama-3-8b-instruct-mopeymule94.7official
180mistral-7b-instruct94.65official
181deepseek-v3.2-exp94.55official
181gpt-4.194.55official
181gpt-6-astra94.55official
181mistral-small-latest94.55official
181qwen3-vl-235b-a22b-instruct94.55official
181qwen3.8-max94.55official
187ai21-jamba-instruct-v1.094.45official
188k2-chat94.41official
189grok-4.594.36official
189krutrim-2-instruct94.36official
191qwen2.5-7b-instruct-1m94.18official
192h2o-danube3-4b-chat94.09official
193zephyr-7b-beta93.94official
194gpt-5.6-luna93.82official
194hunyuan-a13b-instruct93.82official
194seallms-v3-7b-chat93.82official
197gemini-2.0-flash93.64official
198deepseek-chat93.55official
199deepseek-v3.193.45official
200qwen2.5-0.5b-instruct93.36official
201o4-mini93.27official
202deepseek-llm-67b-chat93.14official
202jamba-large-1.693.14official
204gpt-493.09official
205gpt-6-luna92.91official
205open-codestral-mamba92.91official
207sarvam-192.88official
208deepseek-v4-pro92.55official
209gpt-5.6-terra92.36official
210mistral-large-latest92.27official
211falcon-h1-0.5b-instruct92.14official
212llama-3.1-8b-instruct92.07official
213gpt-5.592official
214jamba-1.7-large91.82official
214magistral-medium91.82official
216deepseek-v4-flash91.64official
217gemini-2.5-flash91.48official
218grok-4.391.45official
219longwriter-glm4-9b91.36official
220gpt-6-sol91.27official
221dbrx-instruct91.23official
221jamba-mini-1.691.23official
223gpt-5.6-sol91.09official
224kimi-k290.97official
225gemini-2.0-flash-lite-preview90.73official
226gemini-1.5-flash90.59official
227jamba-1.7-mini90.5official
228smollm-360m-instruct90official
229ai21-jamba-1.5-large-v1.089.64official
229deepseek-v389.64official
231magistral-small89.59official
232gpt-3.5-turbo89.18official
233gpt-oss-120b89.09official
234command-r-plus88.8official
235nexusraven-v2-13b88.64official
236grok-build-0.187.64official
237aya-23-8b86.64official
238nous-hermes-2-mixtral-8x7b-dpo86.59official
239ai21-jamba-1.5-mini-v1.086.36official
240codellama-7b-instruct-hf84.82official
241grok-4.1-fast84.18official
242gemma-2-2b-it84.14official
243aya-23-35b83.18official
244smollm2-1.7b-instruct82.77official
245h2o-danube3-500m-chat82.5official
246foundation-sec-8b82.05official
247smollm2-360m-instruct81.52official
248qwen1.5-14b-chat80.95official
249gpt-oss-20b80official
250rakutenai-7b-instruct79.24official
251qwen2.5-7b-instruct78.73official
252mistral-7b78.18official
253gemma-7b-it77.05official
253smollm-1.7b-instruct77.05official
255komodo-7b-base76.21official
256glm-4-9b-chat75.41official
257sea-lion-v1-7b-it72.58official
258falcon-mamba-7b-instruct71.09official
259gemma-2b-it70.45official
260gemma-2-9b-it70official
261qwen2-7b-instruct66.32official
262olmoe-1b-7b-instruct64.09official
263grok-361.75official
264olmo-7b-instruct-hf59.55official
265powerlm-3b57.27official
266phi-256.36official
267powermoe-3b55official
268rakutenai-7b-chat50.91official