趋近智
Sahabat-AI-Gemma2-9B
参数
9.2B
上下文长度
8.192K
模态
Text
架构
Dense
许可证
Gemma-Community
发布日期
14 Nov 2024
训练数据截止日期
-
技术规格
注意力结构
Multi-Head Attention
隐藏维度大小
-
层数
-
注意力头
-
键值头
-
激活函数
-
归一化
-
位置嵌入
Absolute Position Embedding
系统要求
不同量化方法和上下文大小的显存要求
Sahabat-AI-Gemma2-9B
A 9.2 billion parameter model based on Gemma 2, fine-tuned for Indonesian language tasks. It uses continued pre-training (CPT) to improve understanding of Indonesian context and regional dialects. Released under the Gemma Community License.
关于 Sahabat-AI
Sahabat-AI is an Indonesian language model family co-initiated by GoTo and Indosat Ooredoo Hutchison. Developed with AI Singapore and NVIDIA, it is a collection of models (based on Gemma 2 and Llama 3) specifically optimized for Bahasa Indonesia and regional languages like Javanese and Sundanese.
其他 Sahabat-AI 模型
评估基准
没有可用的 Sahabat-AI-Gemma2-9B 评估基准。