Podcast alert: With AI driving up server GPU prices, will cloud costs rise next?
wrote a fantastic in-depth analysis of the effect this latest AI hype is having on datacenter GPUs.. In short, the demand for machine-learning accelerators to train, test, and run models is driving server-grade GPU prices through the roof, and we're likely to see rises in cloud GPU costs and a rationing of resources, too.
For instance, we've seen top-end Nvidia silicon selling for $40,000 a pop. As Tim wrote:"The situation is worse than the used car market here in the United States, and it is a kind of inflation that comes from too much demand and too little supply. "A situation that vendors love when they know they can't make enough units anyway. The hyperscalers and cloud builders are rationing access to GPUs among their own developers, and we would not be surprised to see price increases for GPU capacity in the cloud."we got together with Tim to discuss the situation, where this leaves IT buyers, and more, and you can watch it all below in less than 20 minutes.'s Tobias Mann, Chris Williams, and regular host Iain Thomson.
Get an idea of what our vultures really think, not just about GPU prices but also why cloud giants build datacenters in seemingly some of the strangest places, cooling technology and choices, the constraints facing these growing large language models, the hardware needed for recommendation systems, and more. ®
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
AI Hype Will Drive Datacenter GPU Prices Sky HighThe datacenter GPU situation is worse than the used car market The hyperscalers and cloud builders are rationing access and we would not be surprised to see price increases for GPU capacity in the cloud. Full story by TDaytonPM at TheNextPlatform
Read more »
Nvidia's mid-range GPU could launch soon — and that's great news for everyoneWe could be getting cheaper graphics cards much sooner than we think
Read more »
Intel's Meteor Lake iGPU is set to shake up the entry level GPU marketIntel is set to take big leap forward in integrated GPU performance.
Read more »
Joe Baggs breaks silence on viral snogging clip of him and Chloe BurrowsRumours that the pair were romantically linked swept the interview following the release of the podcast.
Read more »
Boris Johnson wanted to send Rishi Sunak a meme video calling him a 'c***' after he resignedBoris Johnson wanted to send Rishi Sunak a foul-mouthed video calling him a “c***” after he resigned as chancellor 🔴 The claims have been set out by Guto Harri, who was director of communications in the final months of Johnson’s Downing Street
Read more »