← Models

Model profile

Qwen3 Coder 480B A35B Instruct

Alibabadeveloper
2025-07-22release date
#90 / 267overall rank
3eval lineages

Evidence summary

Qwen3 Coder 480B A35B Instruct has an estimated overall rank of #90; its 90% source-sensitivity interval is #15–#207. Its behavior-only rank is #79; company governance moves the combined estimate to #90. Published evidence spans 3 evals and 2 of 7 behavior components. Its strongest relative result is AA-Omniscience (hallucination_rate, #39 of 311); its weakest is BullshitBench v2 (clear_pushback_rate, #62 of 105).

Compare this model

Only models sharing at least one published sub-eval are listed.

Official and reference links

Published eval results

Rank is within that sub-eval. Black marks the observed result; the grey dot marks the value implied by the global rank. Values stay on each source’s native scale.

Eval / sub-evalRankValueDistributionBetterSource
AA-Omnisciencehallucination_rate#39 / 3110.4329↓ lowerSource ↗official
BullshitBench v2clear_pushback_rate#62 / 1050.2↑ higherSource ↗official
Cisco AI Defense Rolling Single-Turn Leaderboardsingle_turn_attack_success_rate#59 / 10540.78↓ lowerSource ↗official