ApX 标志ApX 标志

趋近智

GreenMind-14B-R1

参数

14B

上下文长度

32.768K

模态

Text

架构

Dense

许可证

Apache-2.0

发布日期

23 Sept 2024

训练数据截止日期

Sep 2024

技术规格

注意力结构

Multi-Head Attention

隐藏维度大小

5120

层数

40

注意力头

40

键值头

8

激活函数

SwigLU

归一化

RMS Normalization

位置嵌入

Absolute Position Embedding

GreenMind-14B-R1

GreenMind-14B-R1 is a 14.7 billion parameter Vietnamese reasoning model developed by GreenNode. It is a dense, decoder-only transformer derived from the Qwen2.5-14B-Instruct base architecture. The model is specifically engineered for multi-step logical reasoning and high-fidelity text generation in the Vietnamese language, addressing common limitations such as language mixing and factual drift in long-form reasoning chains. By implementing Chain-of-Thought (CoT) methodologies, GreenMind is designed to decompose complex queries into intermediate logical steps before producing a final response.

The model utilizes a specialized fine-tuning strategy known as Group Relative Policy Optimization (GRPO), which optimizes the reasoning process while maintaining computational efficiency. This training approach is augmented by a curated Vietnamese instruction dataset consisting of over 55,000 samples spanning cultural, legal, and educational domains. To ensure linguistic consistency, the training pipeline incorporates specific reward functions and Sentence Transformer-based verification to prevent the intrusion of non-Vietnamese characters and to preserve the factual integrity of the reasoning trajectories.

Optimized for deployment via NVIDIA NIM, GreenMind-14B-R1 is intended for enterprise-grade applications including legal and financial assistants, context-aware conversational agents, and complex document retrieval systems. The architecture supports a context length of up to 131,072 tokens for input processing, with a maximum generation limit of 8,192 tokens. Its integration of modern transformer techniques like RoPE position embeddings and SwiGLU activation makes it a technically sophisticated tool for localized AI infrastructure in Vietnam.

关于 GreenMind

GreenMind is an open-source Vietnamese reasoning language model family developed by GreenNode. It is optimized for multi-step reasoning tasks in Vietnamese, such as logic, mathematics, and scenario analysis. The model is designed to run efficiently on single-GPU hardware configurations.


其他 GreenMind 模型
  • 没有相关模型

评估基准

没有可用的 GreenMind-14B-R1 评估基准。

排名

排名

-

编程排名

-

模型透明度

总分

B+

72 / 100

GPU 要求

完整计算器

选择模型权重的量化方法

上下文大小:1024 个令牌

1k
16k
32k

所需显存:

推荐 GPU

GreenMind-14B-R1:规格和 GPU 显存要求