Overall Rank
-
Coding Rank
-
Fugu Max is an efficiency-focused multi-agent orchestration model developed by Sakana AI. It uses learned routing mechanisms to provide cost-effective multimodal reasoning and execution on complex prompts.
Architecture specifications are undisclosed for proprietary models.
Attention
Attention Structure
Undisclosed
Attention Heads
Undisclosed
Key-Value Heads
Undisclosed
Attention Head Dimension
Undisclosed
Position Embedding
Undisclosed
RoPE Theta
Undisclosed
Sliding Window Attention
Undisclosed
Sliding Window Size
Undisclosed
Sliding Window Ratio
Undisclosed
Linear Attention
Undisclosed
Linear Attention Ratio
Undisclosed
Normalization
Undisclosed
Activation Function
Undisclosed
Dimensions
Hidden Dimension Size
Undisclosed
Number of Layers
Undisclosed
FFN Intermediate Size (Dense)
Undisclosed
Multi-Token Prediction Heads
Undisclosed
Tokenizer
Vocabulary Size
Undisclosed
Assistant
Online