趋近智
技术规格
注意力结构
Multi-Head Attention
隐藏维度大小
-
层数
-
注意力头
-
键值头
-
激活函数
-
归一化
-
位置嵌入
Absolute Position Embedding
系统要求
不同量化方法和上下文大小的显存要求
MaLLaM-7B
MaLLaM-7B is a 7 billion parameter language model for Malaysian language tasks including text generation and summarization. Trained on Malaysian government documents, news, and social media, it covers regional variations of Bahasa Malaysia. Released under the Apache 2.0 license.
关于 MaLLaM
Malaysian Large Language Model (MaLLaM) is an open-source language model family developed to support Bahasa Malaysia and English. The model is trained on Malaysian text data including local news, literature, and digital content. It is designed to process Malaysian linguistic nuances and cultural context, available in multiple parameter sizes for different hardware deployments.
其他 MaLLaM 模型
评估基准
没有可用的 MaLLaM-7B 评估基准。