Microsoft Azure’s latest ND MI300X v5 VM is powered by AMD’s MI300X GPU

Will help scale AI with higher computing power and bandwidth memory

3 min. read

Published onMay 23, 2024

published onMay 23, 2024

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

Microsoft is making a ton of investments in its cloud computing platform, Azure. From integrating AI capabilities to introducing new VMs (Virtual Machines), every action right now is customer-centric. And the latest on the list is the Microsoft AzureND MI300X v5VM!

Powered by theAMD Instinct MI300X, the new VM delivers the best high bandwidth memory (HBM) capacity among all available options, according toMicrosoft’s official blog. Its primary use case is to help organizations scale their AI efforts.

Microsoft tells us that the new Azure VMs are powered by 8xAMD MI300XGPUs. Individually, each VM delivers1.5 TBof high bandwidth memory (HBM) and5.3 TB/sof HBM bandwidth.

High HBM capacity and HBM bandwidth are ideal for AI applications, and help process scores of data in no time. And given the compact size, high bandwidth, and low power consumption, HBM becomes key to AI applications.

Besides, the Microsoft AzureND MI300X v5VM runs on theAMD ROCmopen-source software platform, which comes with a wide array of built-in tools and libraries that facilitate seamless AI development and deployment.

For the end customer, it directly results in cost and time savings!

While highlighting the different aspects of the new AzureND MI300X v5VM, Jason Henderson, CVP of Office 365 Product Management at Microsoft, said,

Microsoft also shared that Hugging Face was one of its first partners to switch to the AzureND MI300XVMs and has since then reported 2-3 times performance gains.

The statement of Victor Peng, President of AMD, on the new VM, as available inAMD’s official press release, reads,

The availability of the new Microsoft AzureND MI300X v5VM is currently limited to Canada Central and Sweden Central. As per reports, this is due to central Canada having the most amount of computing capacity, given the presence of massive data centers.

Earlier, Microsoft announcedVMs powered by theAzure Cobalt 100processorin an effort to expand its offerings.

What are your thoughts on the latest AzureND MI300X v5VM? Share with our readers in the comments section.

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low#

Copilot in Outlook will generate personalized themes for you to customize the app#

Microsoft will raise the price of its 365 Suite to include AI capabilities#

Death Stranding Director’s Cut is now Xbox X|S at a huge discount#

Outlook will let users create custom account icons so they can tell their accounts apart easier#

Microsoft Azure’s latest ND MI300X v5 VM is powered by AMD’s MI300X GPU#

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Microsoft Azure’s latest ND MI300X v5 VM is powered by AMD’s MI300X GPU