Technical Specifications

System Requirements

VRAM requirements for different quantization methods and context sizes

Kimi-VL-A3B-Instruct

The Moonshot AI Kimi-VL-A3B-Instruct model is an efficient, open-source Mixture-of-Experts (MoE) vision-language model engineered for advanced multimodal reasoning and long-context understanding. This variant is specifically designed to comprehend both visual and textual inputs, serving as an instruction-tuned model optimized for conversational AI and interactive chat experiences. The model processes diverse inputs including single images, multiple images, videos, and long documents, enabling it to respond to complex natural language queries and instructions. It excels in tasks requiring general multimodal perception, optical character recognition (OCR), understanding of long videos and documents, and agent-based interactions. The model is particularly well-suited for applications such as document analysis, comprehensive video content understanding, and the development of interactive agent systems. Its design prioritizes efficient processing of high-resolution visual inputs coupled with extensive context understanding, making it applicable for scenarios demanding intricate visual and textual comprehension.

Architecturally, Kimi-VL-A3B-Instruct integrates an MoE language model, a native-resolution visual encoder termed MoonViT, and an MLP projector. The model comprises a total of 16 billion parameters, with its design allowing for the activation of approximately 2.8 billion parameters during inference, contributing to its computational efficiency. The underlying MoE language model, Moonlight, was pre-trained on a substantial 5.2 trillion tokens of pure text data and incorporates an 8K context length during this phase. This architecture enables flexible and efficient contextual routing of inputs through its expert sub-networks, with 8 experts selected from a total of 384 experts per token in the language decoder. The MoonViT encoder is designed to process images and videos at their native resolution, preserving visual fidelity for detailed analysis.

MoonViT supports processing high-resolution visual inputs up to 1792x1792 pixels, a fourfold increase compared to its initial release, enabling detailed analysis of screenshots and complex graphics. The model leverages a variable-length sequence attention mechanism, which is compatible with FlashAttention, to maintain efficient training throughput for images of varying resolutions. Kimi-VL-A3B-Instruct's design prioritizes efficient processing of high-resolution visual inputs coupled with extensive context understanding, making it applicable for scenarios demanding intricate visual and textual comprehension.

No evaluation benchmarks for Kimi-VL-A3B-Instruct available.