Nvidia not cutting it? Google and Amazon’s latest AI chips have arrived
Cloud-based AI training got a little more diverse this week after Amazon Web Services and Google Cloud announced the general availability of their latest custom AI accelerators.
Amazon claims the instances are between 40 percent and 250 percent higher performance in BF16 and 32-bit TensorFlow workloads than its Nvidia A100-powered P4d instances, according to Amazon's internal benchmarks. The accelerator also supports FP32, FP16, UINT8, and a configurable FP8 datatype. FP8 hasThe instances are available in two sizes: Amazon's trn1.2xlarge pairs eight vCPUs with a single Trainium chip, 64GB of memory divided evenly between the CPU and accelerator, 12.
The accelerator uses the same Neuron SDK as Amazon's previously announced Inferentia inferencing chip, which comes with a compiler, framework extensions, a runtime library, and developer tools. Put together, Amazon claims workloads written in popular ML frameworks, such as PyTorch and TensorFlow, can be adapted to run on Trainium with minimal refactoring.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Prime Early Access Sale is better than we expected - but still shop with cautionAmazon's latest Prime Day sale is packed with great deals, if you shop wisely
Read more »
Win! One of four Knog lights and bike alarm bundles worth £190Our latest comp has launched today & thanks to Knog you could be heading into autumn with a brand new set of its Blinder front & rear lights & a Scout bike alarm. We've got 4 bundles — each worth over £190 — to give away to our UK readers! sponsored
Read more »
Samsung Kyiv headquarters damaged by Russian missile strikeR&D Center focuses on autonomous AI, otherwise known as On-Device AI
Read more »
LIVE: Early Access for Amazon Prime Day 2022 - latest dealsFollow our live blog below on the first deals to arrive before Amazon Prime Day begins tomorrow (October 11)
Read more »
Google Chromecast 4K is on offer for Amazon's Prime Early Access SaleHey Google, tell us about some streaming savings.
Read more »