deep dive: It's almost like AWS is building its own Stargate
Amazon Web Services is in the process of building out a massive supercomputing cluster containing"hundreds of thousands" of accelerators that promises to give its model building buddies at Anthropic a leg up in the AI arms race.
However, we're told that Anthropic has already managed to get their hands on a sliver of the system's compute. The chip itself features a pair of 5nm compute dies glued together using TSMC's chip-on-wafer-on-substrate packaging tech, which is fed by four HBM stacks. Combined, each Trainium2 accelerator offers 1.3 petaFLOPS of dense FP8 performance, 96GB of HBM, and 2.9TB/s of memory bandwidth.
Compared to Nvidia's HGX B200 systems, the performance gap is far closer. The Blackwell-based parts still have an advantage when it comes to memory bandwidth and dense FP8 compute, which are key indicators of inference performance. Four Trn2 systems can then be meshed together using NeuronLink to expand the compute domain from 16 chips to 64, in a configuration AWS is calling an UltraServer.
This isn't your typical Ethernet network, either. Amazon has developed a custom fabric that they say will deliver tens of petabits of bandwidth with under 10 microseconds of latency across the network.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Reddit sues Anthropic for scraping content into the maw of its eternally ravenous AI: All the cool kids signed licensing deals with the recently-listed forum site
Read more »
Anthropic won't fix a bug in its SQLite MCP server: Fork that - 5k+ times
Read more »
Anthropic: All the major AI models will blackmail us if pushed hard enough: Just like people
Read more »
Anthropic chucks chump change at studies on job-killing tech: $61B business offers $10K–$50K grants to assess AI’s job-market impact
Read more »
The problem of AI chatbots telling people what they want to hearOpenAI, DeepMind and Anthropic tackle the growing issue of models producing responses that are too sycophantic
Read more »
The struggle to get inside how AI models really workAnthropic, Google and OpenAI deploy ‘chains of thought’ to better understand the operations of AI systems
Read more »