GreenMind-14B-R1
Parameters
14B
Context Length
33K
Modality
Text
Architecture
Dense
KV Cache Rate
160 KB/tok
License
Apache-2.0
Release Date
23 Sept 2024
Knowledge Cutoff
Sep 2024
API Pricing (per 1M)
Self-hosted only
Hardware & System Requirements
Precision
Context
Workload Memory: 10.27 GB
INT4 · 8K context
Base Weights: 6.52 GB
KV Cache: 1.25 GB
Runtime & Graphs: 2.50 GB
Minimum Required Hardware
1x NVIDIA L4 24GB
10.3 / 21.6 GB usable
1x RTX 3060 12GB
10.3 / 10.8 GB usable
Apple M4 24GB
10.3 / 18.0 GB usable
Determine requirements for your specific workload:
Open in VRAM Calculator
Runtime requirements
Checkpoint format
FP16
CUDA
>= 11.8
PyTorch
>= 2.1
Transformers
>= 4.40.1
| Architecture | Precision | Attention kernel |
|---|---|---|
Blackwell, Hopper | Native FP16 | FlashAttention-3 |
Ada Lovelace, Ampere | Native FP16 | FlashAttention-2 |
Architecture Diagram
Evaluation Benchmarks
No evaluation benchmarks for GreenMind-14B-R1 available.
Rankings
Overall Rank
-
Coding Rank
-
About GreenMind-14B-R1
GreenMind-14B-R1 is a 14.7B parameter Vietnamese reasoning model developed by GreenNode on Qwen2.5-14B using GRPO reinforcement learning. It specializes in multi-step logical deduction and domain-specific assistance across a 131K context window.
Specifications
Attention
Attention Structure
Multi-Head Attention
Attention Heads
40
Key-Value Heads
8
Position Embedding
Absolute Position Embedding
Normalization
RMS Normalization
Activation Function
SwigLU
Dimensions
Base Precision
FP16
Hidden Dimension Size
5,120
Number of Layers
40
About GreenMind
GreenMind is an open-source Vietnamese reasoning language model family developed by GreenNode. It is optimized for multi-step reasoning tasks in Vietnamese, such as logic, mathematics, and scenario analysis. The model is designed to run efficiently on single-GPU hardware configurations.
Other GreenMind Models
- No related models available