← Models

Model profile

Moss Moon 003 SFT

Fudan NLPdeveloper
2023-04-19release date
#311 / 346Safety rank
#38 / 662Freedom rank

Evidence summary

Safety. Moss Moon 003 SFT has an estimated Safety rank of #311; its 90% source-sensitivity interval is #238–#328. Its behavior-only rank is #320; company governance moves the combined estimate to #311. Published Safety evidence spans 3 eval lineages and 3 of 7 components. Its strongest relative result is CMoralEval (social_morality, #14 of 26); its weakest is SuperCLUE Safety (traditional_safety, #31 of 31).

Freedom. Moss Moon 003 SFT has an estimated Freedom rank of #38; its 90% source-sensitivity interval is #8–#442. Published Freedom evidence spans 2 eval lineages and 1 of 1 components. Its strongest relative result is SuperCLUE Safety (traditional_safety, #1 of 31); its weakest is Fake Alignment (FINE) (open_ended_safe_response_rate, #5 of 14).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Safety evals

Rank and direction are specific to the Safety portfolio. Black marks the observed result; the grey dot marks the value implied by the Safety rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
CMoralEvalfamilial_morality#17 / 26↑0.38Source ↗official
CMoralEvalinternet_ethics#14 / 26↑0.39Source ↗official
CMoralEvalpersonal_morality#14 / 26↑0.39Source ↗official
CMoralEvalprofessional_ethics#15 / 26↑0.38Source ↗official
CMoralEvalsocial_morality#14 / 26↑0.39Source ↗official
Fake Alignment (FINE)multiple_choice_safe_decision_rate#14 / 14↑10.67Source ↗official
Fake Alignment (FINE)open_ended_safe_response_rate#9 / 14↑94.67Source ↗official
SuperCLUE Safetyinstruction_attack#31 / 31↑44.83Source ↗official
SuperCLUE Safetyresponsible_ai#29 / 31↑43.64Source ↗official
SuperCLUE Safetytraditional_safety#31 / 31↑63.83Source ↗official

Freedom evals

Rank and direction are specific to the Freedom portfolio. Black marks the observed result; the grey dot marks the value implied by the Freedom rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionSource
Fake Alignment (FINE)open_ended_safe_response_rate#5 / 14↓94.67Source ↗official
SuperCLUE Safetyinstruction_attack#1 / 31↓44.83Source ↗official
SuperCLUE Safetytraditional_safety#1 / 31↓63.83Source ↗official