Microsoft has introduced the Maia 300 AI chip, which will serve as the primary AI inference system for its products and services, the company announced on Monday. It is claimed to provide 40 percent more tokens per megawatt in comparison to other GPU-based inference systems. Further, the Maia 300 chip will serve as Microsoft’s primary AI inference platform, powering its in-house AI products and services. The AI chip has been optimised for long-context, memory-intensive, and decode-heavy AI workloads. It can balance compute, memory bandwidth, networking, and power efficiency at cloud scale.

See all 264 in Gadgets →

By

Leave a Reply

Your email address will not be published. Required fields are marked *