Tens of thousands of AWS’ Trn2 instances to fuel Anthropic's next-gen models
Amazon Web Services teased its next gen AI accelerator dubbed Trainium3 at re:Invent on Tuesday, which it says will deliver 4x higher performance than its predecessor when it arrives late next year.
We've reached back out to AWS for clarification, but if we had to guess, we're probably looking at either 6-bit or 4-bit floating point math — something that Nvidia is bringing to market with Blackwell and AMD plans to introduce with the MI355X sometime next year. While Amazon is willing to tease performance and efficiency metrics, it has yet to share details on the chip's memory load out.
Here's a closer look at AWS' new Trn2 UltraServers, which boast 64 Tranium2 chips across two racks. - Click to enlarge For those using the chips to train models, Trainium2 can scale to even larger clusters with 100,000 or more chips. This is exactly what AWS and model builder Anthropic plan to do under Project Rainier, which will involve putting"hundreds of thousands" of Trainium2 chips into a cluster for AI training. That supercomputing system, due to power up in full in 2025, is said to be capable of producing"5x the number of exaFLOPS used to train latest generation of AI models.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
F1 2025 driver line-up: Who is already confirmed for the 2025 grid?Keep up to date with every F1 2025 driver announcement in a very busy silly season.
Read more »
Popular baby names for 2025 and the ones set to become extinctChoosing a baby name is up there with the trickiest of decisions
Read more »
James Anderson: England's record Test wicket taker registers for the IPL 2025 mega auctionEngland's record Test wicket-taker James Anderson has registered for the IPL 2025 mega auction but Ben Stokes has opted out.
Read more »
Sauber signs Bortoleto to 2025 F1 race seat ahead of Audi eraThe F2 championship leader will make his F1 debut in 2025
Read more »
Donald Trump's Project 2025 and 'dangerous' blueprint for US explainedDonald Trump is set to make an announcement on Project 2025, a blueprint for his second term as US President which has caused concern among Democrats.
Read more »
Sauber sign Brazilian rookie Gabriel Bortoleto for 2025 seasonGabriel Bortoleto, 20, will make his Formula One debut for the Audi-owned Sauber next season.
Read more »