ApX logoApX logo

GreenMind-14B-R1

Parameters

14B

Context Length

33K

Modality

Text

Architecture

Dense

License

Apache-2.0

Release Date

23 Sept 2024

Knowledge Cutoff

Sep 2024

API Pricing (per 1M)

Self-hosted only

System Requirements

VRAM requirements for different quantization methods and context sizes

1,024 tokens

29.04 GB VRAM

Consumer

2x RTX 4090

24GB VRAM

Datacenter

1x NVIDIA A100

80GB VRAM

Apple Silicon

1x Apple M3 Max

128GB VRAM

32,768 tokens

34.13 GB VRAM

Consumer

2x RTX 4090

24GB VRAM

Datacenter

1x NVIDIA A100

80GB VRAM

Apple Silicon

1x Apple M3 Max

128GB VRAM

Architecture Diagram

Evaluation Benchmarks

No evaluation benchmarks for GreenMind-14B-R1 available.

Rankings

Overall Rank

-

Coding Rank

-

About GreenMind-14B-R1

GreenMind-14B-R1 is a 14.7B parameter Vietnamese reasoning model developed by GreenNode on Qwen2.5-14B using GRPO reinforcement learning. It specializes in multi-step logical deduction and domain-specific assistance across a 131K context window.

Technical Specifications

Attention

Attention Structure

Multi-Head Attention

Attention Heads

40

Key-Value Heads

8

Position Embedding

Absolute Position Embedding

Normalization

RMS Normalization

Activation Function

SwigLU

Dimensions

Hidden Dimension Size

5,120

Number of Layers

40

About GreenMind

GreenMind is an open-source Vietnamese reasoning language model family developed by GreenNode. It is optimized for multi-step reasoning tasks in Vietnamese, such as logic, mathematics, and scenario analysis. The model is designed to run efficiently on single-GPU hardware configurations.


Other GreenMind Models
  • No related models available