趋近智
Qwen3.5-9B
参数
9B
上下文长度
262.144K
模态
Multimodal
架构
Dense
许可证
Apache 2.0
发布日期
24 Feb 2026
训练数据截止日期
-
技术规格
注意力结构
Grouped-Query Attention
隐藏维度大小
4096
层数
32
注意力头
16
键值头
4
激活函数
SwigLU
归一化
RMS Normalization
位置嵌入
ROPE
Qwen3.5-9B
Qwen3.5-9B is Alibaba Cloud's efficient multimodal foundation model with 9B parameters, released February 2026. It uses a hybrid architecture combining Gated Delta Networks and Gated Attention in an 8×(3×DeltaNet→FFN→1×Attention→FFN) pattern. It achieves strong scores on MMLU-Pro (82.5%), GPQA Diamond (81.7%), HMMT benchmarks (90%/90%), and LiveCodeBench v6 (82.7%). Features unified vision-language capabilities, 262k native context (extensible to 1M), multi-token prediction training, and excels in multimodal reasoning, coding, agents, and multilingual tasks across 201 languages.
关于 Qwen 3.5
Qwen 3.5 is Alibaba Cloud's latest-generation foundation model family, released February 2026. It represents a significant leap forward, integrating breakthroughs in multimodal learning (unified vision-language foundation), efficient hybrid architecture (Gated Delta Networks with sparse Mixture-of-Experts), scalable reinforcement learning across million-agent environments, and global linguistic coverage spanning 201 languages. Available under Apache 2.0 license with open weights.
其他 Qwen 3.5 模型
评估基准
没有可用的 Qwen3.5-9B 评估基准。