Google Cloud wants to make it a lot easier to run massive ML workloads
Users will have a new way to access Google Cloud’s ML might
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
GoogleCloud has announced the general availability of its TPU virtual machines.
Tensor Processing Units (TPUs) are application-specific integrated circuits (ASICs) developed by Google which are used to accelerate machine learning workloads.
Cloud TPU enables you to run your machine learning workloads on thecloud hostinggiant’sTPU accelerator hardwareusing open source machine learning platformTensorFlow.
What can TPU VMs do for users?
Google says its user community has adopted virtual TPUs as they provide a better debugging experience and also enable certain training setups, including Distributed Reinforcement Learning, which it says were not feasible with existing TPU Node (networks accessed) architecture.
Cloud TPUs are optimized for large scale ranking and recommendation workloads according to Google, citing howSnapwas an early adopter of this capability.
In addition, with the TPU VMs GA release, Google is introducing a newTPU Embedding API, which it says can accelerate ML based ranking and recommendation workloads.
Google highlighted how many modern businesses rely on ranking and recommendation use cases, such as audio and video recommendations, product recommendations, and ad ranking.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
Google Cloud is launching a Web3 team>Google Cloud is making a major change to its VMs>AWS rekindles a crafty scheme to get developers into machine learning
The tech giant said that TPUs can help businesses implement a deep neural network-based approach to tackling the above use cases, which it says can be expensive and data intensive to train.
Google also says its TPU VMs offer several additional capabilities over existing TPU Node architecture due to their local execution setup, as the input data pipeline can execute directly on the TPU hosts, saving organizations computing resources.
TPU VM GA Release also supports other ML major frameworks such as PyTorch and JAX.
Interested in deploying a virtual TPU? You can follow one of Google’squick startsortutorials.
Will McCurdy has been writing about technology for over five years. He has a wide range of specialities including cybersecurity, fintech, cryptocurrencies, blockchain, cloud computing, payments, artificial intelligence, retail technology, and venture capital investment. He has previously written for AltFi, FStech, Retail Systems, and National Technology News and is an experienced podcast and webinar host, as well as an avid long-form feature writer.
A new form of macOS malware is being used by devious North Korean hackers
Ulefone Armor 27T Pro rugged phone review
Google puts Nvidia on high alert as it showcases Trillium, its rival AI chip, while promising to bring H200 Tensor Core GPUs within days