Topic
inference
Stories
Stage · Medium2 sourcesTech
Microsoft's Maia 300: 96 chips per rack, 40% more tokens per megawatt than GPUs
Microsoft's Maia 300 packs 96 chips into each data center rack, double the Maia 200's count, and Microsoft says a rack can process up to seven times more AI tokens than its predecessor.
Stage · Medium3 origins · 2 sourcesTech
Microsoft's Maia 300: 40% more tokens per megawatt, but not until 2027
Microsoft said Maia 300, its third-generation in-house AI chip, will deliver 40% more tokens per megawatt than leading GPU-based systems, per cloud chief Scott Guthrie.