Meta’s Open-Source Multimodal Series AI Model — Llama 4, Recaptures the Crown of Open Source
Meta has released the Llama 4 series of AI models, including Llama 4 Scout, Llama 4 Maverick, and Llama 4 Behemoth. These models utilize a “Mixture of Experts” (MoE) architecture, which assigns data processing tasks to specialized “expert” models, thereby improving training and response efficiency. Maverick has 400 billion parameters, with 170 billion parameters active among 128 “expert” models. Scout has 170 billion active parameters across 16 “expert” models, with a total of 1090 billion parameters.
© Copyright Notice
The copyright of the article belongs to the author. Please do not reprint without permission.
Related Posts
No comments yet...