Microsoft's Maia 300 rack: 96 accelerators, HBM4, mostly liquid-cooled

Microsoft has released architecture details for Maia 300, its third-generation Azure AI accelerator. The design pairs 96 accelerators per rack with a two-tier network that links up to 12,288 accelerators into a single superpod. The company says the system is built for cloud-scale agentic inference…

aicloudhardwarereleases

Sources

Microsoft's Maia 300 rack: 96 accelerators, HBM4, mostly liquid-cooled · TechNews