Start / Last Week in AI / 206 llama 4 nova act xai buys x paperbench

#206 - Llama 4, Nova Act, xAI buys X, PaperBench

74 min • 9 april 2025

Our 206th episode with a summary and discussion of last week's big AI news!
Recorded on 04/07/2025

Try out the Astrocade demo here! https://www.astrocade.com/

Hosted by Andrey Kurenkov and Jeremie Harris.
Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.

Join our Discord here! https://discord.gg/nTyezGSKwP

In this episode:

Meta releases LlAMA-4, a series of advanced large language models, sparking debate on performance and release timing, with models featuring up to 2 trillion parameters for different configurations and applications.
Amazon's AGI Lab debuts NOVA Act, an AI agent for web browser control, boasting competitive benchmarking against OpenAI's and Anthropic's best agents.
OpenAI's image generation capabilities and ongoing financing developments, notably a $40 billion funding round led by SoftBank, highlight significant advancements and strategic shifts in the tech giant’s operations.

Timestamps + Links:

(00:00:00) Intro / Banter

Tools & Apps

(00:01:46) Meta releases Llama 4, a new crop of flagship AI models
(00:13:55) Amazon unveils Nova Act, an AI agent that can control a web browser
(00:17:06) Alibaba Preparing for Flagship AI Model Release as Soon as April
(00:17:59) Runway releases an impressive new video-generating AI model
(00:19:10) Adobe launches Premiere Pro’s generative AI video extender
(00:20:54) OpenAI prepares reasoning slider and memory update for ChatGPT users

Applications & Business

Research & Advancements

(00:38:03) PaperBench: Evaluating AI's Ability to Replicate AI Research
(00:43:50) Crossing the Reward Bridge: Expanding RL with Verifiable Rewards Across Diverse Domains
(00:48:39) Inference-Time Scaling for Complex Tasks: Where We Stand and What Lies Ahead
(00:54:34) Overtrained Language Models Are Harder to Fine-Tune

Policy & Safety

(00:58:28) Taking a responsible path to AGI
(01:02:32) This A.I. Forecast Predicts Storms Ahead
(01:06:24) The Secrets and Misdirection Behind Sam Altman’s Firing From OpenAI

Senaste avsnitt

#206 - Llama 4, Nova Act, xAI buys X, PaperBench

Senaste avsnitt

#217 - ChatGPT Agent, Kimi k2, Hiring Drama

#216 - Grok 4, Project Rainier, Kimi K2

#215 - Runway games, Meta Superintelligence, ERNIE 4.5, Adaptive Tree Search

#214 - Gemini CLI, io drama, AlphaGenome, copyright rulings

#213 - Midjourney video, Gemini 2.5 Flash-Lite, LiveCodeBench Pro

#212 - o3 pro, Cursor 1.0, ProRL, Midjourney Sued

#211 - Claude Voice, Flux Kontext, wrong RL research?

#210 - Claude 4, Google I/O 2025, OpenAI+io, Gemini Diffusion

#209 - OpenAI non-profit, US diffusion rules, AlphaEvolve

#208 - Claude Integrations, ChatGPT Sycophancy, Leaderboard Cheats

#207 - GPT 4.1, Gemini 2.5 Flash, Ironwood, Claude Max

#206 - Llama 4, Nova Act, xAI buys X, PaperBench

#205 - Gemini 2.5, ChatGPT Image Gen, Thoughts of LLMs

#204 - OpenAI Audio, Rubin GPUs, MCP, Zochi

#203 - Gemini Image Gen, Ascend 910C, Gemma 3, Gemini Robotics

#202 - Qwen-32B, Anthropic's $3.5 billion, LLM Cognitive Behaviors

#201 - GPT 4.5, Sonnet 3.7, Grok 3, Phi 4

#200 - ChatGPT Roadmap, Musk OpenAI Bid, Model Tampering

#199 - OpenAI's 03-mini, Gemini Thinking, Deep Research, s1

#198 - DeepSeek R1 & Janus, Qwen2.5, OpenAI Agents

AI Computing Hardware - Past, Present, and Future

#197 - AI in Gmail+Docs, MiniMax-01, Titans, Transformer^2

#196 - Nvidia Digits, Cosmos, PRIME, ICLR, InfAlign

#195 - OpenAI o3 & for-profit, DeepSeek-V3, Latent Space

#194 - Gemini Reasoning, Veo 2, Meta vs OpenAI, Fake Alignment

#193 - Sora release, Gemini 2, OpenAI's AGI Rule, US AI Czar

#192 - ChatGPT Pro, Amazon Nova, GenFM, Llama 3.3, Genie 2

#191 - Sora leak, Pixtral Large, OpenAI email archives

#190 - AI scaling struggles, OpenAI Agents, Super Weights

#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

#188 - ChatGPT+Search, OpenAI+AMD, SimpleQA, π0

#187 - Anthropic Agents, Mochi1, 3.4B data center, OpenAI's FAST image gen

#186 - Adobe AI Tools, Tesla's Cybercab, Nobel Prizes

#185 - Movie Gen, ChatGPT Canvas, OpenAI's VC Round, SB 1047 Vetoed

#184 - OpenAI's Voice 2.0 + execs quitting, Llama 3.2, To CoT or not to CoT?

#183 - OpenAI o1, Adobe vid gen, Reflection 70B, DeepMind AlphaProteo

# 182 - Alexa 2.0, MiniMax, Surskever raises $1B, SB 1047 approved

#181 - Google Chatbots, Cerebras vs Nvidia, AI Doom, ElevenLabs Controversy

#180 - Ideogram v2, Imagen 3, AI in 2030, Agent Q, SB 1047

#179 - Grok 2, Gemini Live, Flux, FalconMamba, AI Scientist

#178 - More Not-Acquihires, More OpenAI drama, More LLM Scaling Talk

#177 - Instagram AI Bots, Noam Shazeer -> Google, FLUX.1, SAM2

#176 - BIG WEEK for OSS! SearchGPT, Lamma 3.1 405B, Mistral Large 2

#175 - GPT-4o Mini, OpenAI's Strawberry, Mixture of A Million Experts

#174 - Odyssey Text-to-Video, Groq LLM Engine, OpenAI Security Issues

#173 - Gemini Pro, Llama 400B, Gen-3 Alpha, Moshi, Supreme Court

#172 - Claude and Gemini updates, Gemma 2, GPT-4 Critic

#171 - Apple Intelligence, Dream Machine, SSI Inc

#170 - new Sora rival, OpenAI robotics, understanding GPT4, AGI by 2027?

#169 - Google's Search Errors, OpenAI news & DRAMA, new leaderboards

#168 - OpenAI vs Scar Jo + safety researchers, MS AI updates, cool Anthropic research

#167 - GPT-4o, Project Astra, Veo, OpenAI Departures, Interview with Andrey

#166 - new AI song generator, Microsoft's GPT4 efforts, AlphaFold3, xLSTM, OpenAI Model Spec

#165 - Sora challenger, Astribot's S1, Med-Gemini, Refusal in LLMs

#164 - Meta AI, Phi-3, OpenELM, Bollywood Deepfakes

#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

#161 - Claude 3 beats GPT-4, Stability CEO resigns, DBRX, TacticAI, UN resolution on AI

#160 - Nvidia's new GPU, Microsoft pays for Inflection AI, Grok-1 open sourced, Jeremie's Action Plan

#159 - Inflection-2.5, Devin, OpenAI board update, SIMA, EU AI Act passed

#158 - Claude 3, Elon Musk sues OpenAI, StarCoder 2, AI-Generated Spam

#157 - Gemini controversy, new Mistral models, Deepmind's Genie & Griffinn, AI Warfare is here

#156 - OpenAI's Sora, Gemini 1.5, BioMistral, V-JEPA, AI Task Force, Fun!

#155 - ChatGPT memory, Altman seeks trillions, Califonia AI regulation, art gen lawsuit

#154 - Google Gemini, Waymo Collision, Smaug-72B, EU AI Act final text, image watermarks

#153 - Taylor Swift Deepfakes, ChatGPT features, Meta-Prompting, two new US bills

#152 - live translation on phones, Meta aims at AGI, AlphaGeometry, political deepfakes

#151 - Copilot Pro, LLama.cpp, conversational diagnostic AI, secret AI diplomacy

#150 - GPT Store, new Nvidia chips, DeepMind’s robotics progress, bad uses of AI

#149 - Reflecting on 2023, Midjourney v6, Anthropic Revenue, Unified-IO 2, NY Times sues OpenAI

#148 - Imagen 2, Midjourney on web, FunSearch, OpenAI ‘Preparedness Framework’, campaigning voice clone

#147 - Google’s Gemini, EU AI Act Deal, Mixtral of Experts, Meta’s ‘Seamless’ translator

#146 - ChatGPT’s 1 year anniversary, DeepMind GNoME, Extraction of Training Data from LLMs, AnyDream

#145 - OpenAI’s Q*, Claude 2.1, Stable Video Diffusion, Starling-7B, Orca 2, international agreements

#144 - OpenAI CEO UN-FIRED, Cruise founders quit, Meta video editing, LLMs can lie, policy updates

#143 - OpenAI CEO FIRED, Cruise halts driving, xAI’s Grok, DeepMind defines AGI, actor strike over

#142 - Humanoid Robots, Video-To-Text, Habitat 3.0, Cruise troubles, data poisoning

#141 - Adobe AI upgrades, Ernie 4.0, TimeGPT, No Fakes Act, AI drones