Running AI models is turning into a memory game

When we talk about the cost of AI infrastructure, the focus is usually on Nvidia and GPUs -- but memory is an increasingly important part of the picture.

Learn more about your ad choices. Visit podcastchoices.com/adchoices

Om avsnittet

Fler avsnitt

OpenAI will start watermarking ChatGPT’s text in the EU; plus, Lucid Motors’ EV output falls to lowest level in almost 2 years

Federal judge calls Flock ‘indiscriminate mass surveillance’; plus, Amazon responds to data center backlash

Musk’s AI chatbot Grok reportedly encouraged Trump to capture Venezuela’s president; plus, Opus 5.5 loves to tell you ‘this matters’

Hackers stole millions of US military personnel records during months-long data breach; BMW built the same car for gas and electric. The EV is cheaper

OpenAI takes on Microsoft with the launch of what feels a whole lot like ChatGPT’s own office suite

Nvidia launches new platform for reining in rogue AI agents; plus, the AI boom took over Climate Week and not everyone is happy about it

Unsecured OpenAI agents posted 53 user images on the internet without the lab’s knowledge; plus, Meta opens early access, and Insurers claim AI is already increasing healthcare costs

Muse Charm is tapping into a trend; Australia to investigate if OpenAI hack

Even Americans who use AI every day are worried about it

Meta admits Muse’s likeness to OpenClaw isn’t a coincidence; plus, Qualcomm launches two new smartphone chips with emphasis on AI