ApX 标志ApX 标志

趋近智

Grok Code Fast

参数

314B

上下文长度

128K

模态

Text

架构

Dense

许可证

Proprietary

发布日期

1 Jun 2025

训练数据截止日期

Jan 2025

技术规格

注意力结构

Multi-Head Attention

隐藏维度大小

6144

层数

64

注意力头

48

键值头

8

激活函数

-

归一化

RMS Normalization

位置嵌入

Absolute Position Embedding

Grok Code Fast

Grok Code Fast is a specialized large language model developed by xAI, engineered specifically to support high-velocity agentic coding workflows. Built from the ground up with a custom architecture, the model is pre-trained on a massive corpus of programming-related data and fine-tuned using high-quality post-training datasets derived from real-world pull requests and practical software engineering tasks. This specialization allows the model to maintain a high degree of proficiency in popular languages such as TypeScript, Python, Java, Rust, C++, and Go, while remaining optimized for the low-latency demands of real-time development environments.

Technically, the model utilizes a sparse Mixture-of-Experts (MoE) architecture designed to balance computational efficiency with high-capacity reasoning. This structural choice enables the model to process complex instructions and manage multi-step tool interactions without the latency penalties typically associated with dense models of similar scale. A defining characteristic of Grok Code Fast is its deep integration with developer tools; it is specifically trained to execute terminal operations, perform repository-wide file searches using utilities like grep, and carry out precise code refactors. The model also incorporates advanced prompt caching techniques, which significantly reduce response times for repetitive context-heavy queries common in IDE-based interactions.

In practical application, Grok Code Fast is optimized for autonomous and semi-autonomous tasks such as project scaffolding, codebase exploration, and surgical bug fixing. It features an expansive 256,000-token context window, providing the necessary memory for the model to ingest and reason over substantial portions of a repository simultaneously. By prioritizing throughput and tool-calling reliability, the model serves as a responsive backend for modern AI-driven coding assistants and automated agents that require a tight feedback loop between reasoning and code execution.

关于 Grok

xAI's conversational AI models with real-time knowledge access and strong performance across reasoning, coding, and language tasks. Features extended context windows, fast inference variants, and specialized coding versions. Known for direct communication style and integration with X platform. Includes reasoning variants and optimized versions for different latency requirements.


其他 Grok 模型

评估基准

排名

#80

基准分数排名

0.69

24

Agentic Coding

LiveBench Agentic

0.33

25

0.42

31

0.64

40

0.56

43

排名

排名

#80

编程排名

#81