Microsoft Launches Mu, a Compact On-Device Language Model for Windows 11 Devices

Microsoft has unveiled an innovative small-parameter model called Mu. With just 330 million parameters, Mu delivers performance comparable to Microsoft’s Phi-3.5-mini model while being about 10 times smaller in size. It achieves an impressive response speed of over 100 tokens per second on NPU-equipped laptops.