Hunyuan Lite
Parameters
7B
Context Length
250K
Modality
Text
Architecture
Dense
KV Cache Rate
128 KB/tok
License
Tencent Hunyuan Community License
Release Date
30 Oct 2024
Knowledge Cutoff
Aug 2024
API Pricing (per 1M)
Self-hosted only
Hardware Sizing
Precision
Context
Workload Memory: 6.76 GB
INT4 · 8K context
Base Weights: 3.26 GB
KV Cache: 1.00 GB
Runtime & Graphs: 2.50 GB
Minimum Required Hardware
1x NVIDIA L4 24GB
6.8 / 21.6 GB usable
1x RTX 3060 12GB
6.8 / 10.8 GB usable
Apple M4 24GB
6.8 / 18.0 GB usable
Determine requirements for your specific workload:
Open in VRAM Calculator
Architecture Diagram
Evaluation Benchmarks
No evaluation benchmarks for Hunyuan Lite available.
Rankings
Overall Rank
-
Coding Rank
-
About Hunyuan Lite
Hunyuan Lite is an edge-optimized dense language model developed by Tencent for laptops, mobile devices, and in-vehicle systems. It supports dual-mode reasoning and long-document analysis across an expansive 256K token context window.
Technical Specifications
Attention
Attention Structure
Multi-Head Attention
Attention Heads
32
Key-Value Heads
8
Position Embedding
Absolute Position Embedding
Normalization
RMS Normalization
Activation Function
SwigLU
Dimensions
Hidden Dimension Size
4,096
Number of Layers
32
About Hunyuan
Tencent Hunyuan large language models with various capabilities.