Start / Last Week in AI / 163 llama 3 grok 1 5 vision new atlas robot rho 1 medium ban

#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

94 min • 24 april 2024

Our 163rd episode with a summary and discussion of last week's big AI news!

Note: apology for this one coming out a few days late, got delayed in editing it -Andrey

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai

Timestamps + links:

Intro / Banter
Tools & Apps
- (00:02:16) Meta releases Llama 3, claims it’s among the best open models available
- (00:14:01) Elon Musk’s xAI Unveils Grok-1.5 Vision, Beats OpenAI’s GPT-4V
- (00:17:55) Reka releases Reka Core, its multimodal language model to rival GPT-4 and Claude 3 Opus
- (00:21:50) Cohere Compass Private Beta: A New Multi-Aspect Embedding Model
- (00:23:48) Amazon Music’s Maestro lets listeners make AI playlists
- (00:24:36) Snap plans to add watermarks to images created with its AI-powered tools
Applications & Business
Projects & Open Source
- (00:44:08) OpenEQA: Embodied Question Answering in the Era of Foundation Models
- (00:50:03) Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
Research & Advancements
- (00:51:21) RHO-1: Not All Tokens Are What You Need
- (00:57:21) Scaling Laws for Fine-Grained Mixture of Experts
- (01:03:20) Chinchilla Scaling: A replication attempt
- (01:07:18) China develops new light-based chiplet that could power artificial general intelligence — where AI is smarter than humans
- (01:10:45) OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
Policy & Safety
Synthetic Media & Art
- (01:30:25) Medium bans AI-generated content from its paid Partner Program

Senaste avsnitt

#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

Senaste avsnitt

#217 - ChatGPT Agent, Kimi k2, Hiring Drama

#216 - Grok 4, Project Rainier, Kimi K2

#215 - Runway games, Meta Superintelligence, ERNIE 4.5, Adaptive Tree Search

#214 - Gemini CLI, io drama, AlphaGenome, copyright rulings

#213 - Midjourney video, Gemini 2.5 Flash-Lite, LiveCodeBench Pro

#212 - o3 pro, Cursor 1.0, ProRL, Midjourney Sued

#211 - Claude Voice, Flux Kontext, wrong RL research?

#210 - Claude 4, Google I/O 2025, OpenAI+io, Gemini Diffusion

#209 - OpenAI non-profit, US diffusion rules, AlphaEvolve

#208 - Claude Integrations, ChatGPT Sycophancy, Leaderboard Cheats

#207 - GPT 4.1, Gemini 2.5 Flash, Ironwood, Claude Max

#206 - Llama 4, Nova Act, xAI buys X, PaperBench

#205 - Gemini 2.5, ChatGPT Image Gen, Thoughts of LLMs

#204 - OpenAI Audio, Rubin GPUs, MCP, Zochi

#203 - Gemini Image Gen, Ascend 910C, Gemma 3, Gemini Robotics

#202 - Qwen-32B, Anthropic's $3.5 billion, LLM Cognitive Behaviors

#201 - GPT 4.5, Sonnet 3.7, Grok 3, Phi 4

#200 - ChatGPT Roadmap, Musk OpenAI Bid, Model Tampering

#199 - OpenAI's 03-mini, Gemini Thinking, Deep Research, s1

#198 - DeepSeek R1 & Janus, Qwen2.5, OpenAI Agents

AI Computing Hardware - Past, Present, and Future

#197 - AI in Gmail+Docs, MiniMax-01, Titans, Transformer^2

#196 - Nvidia Digits, Cosmos, PRIME, ICLR, InfAlign

#195 - OpenAI o3 & for-profit, DeepSeek-V3, Latent Space

#194 - Gemini Reasoning, Veo 2, Meta vs OpenAI, Fake Alignment

#193 - Sora release, Gemini 2, OpenAI's AGI Rule, US AI Czar

#192 - ChatGPT Pro, Amazon Nova, GenFM, Llama 3.3, Genie 2

#191 - Sora leak, Pixtral Large, OpenAI email archives

#190 - AI scaling struggles, OpenAI Agents, Super Weights

#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

#188 - ChatGPT+Search, OpenAI+AMD, SimpleQA, π0

#187 - Anthropic Agents, Mochi1, 3.4B data center, OpenAI's FAST image gen

#186 - Adobe AI Tools, Tesla's Cybercab, Nobel Prizes

#185 - Movie Gen, ChatGPT Canvas, OpenAI's VC Round, SB 1047 Vetoed

#184 - OpenAI's Voice 2.0 + execs quitting, Llama 3.2, To CoT or not to CoT?

#183 - OpenAI o1, Adobe vid gen, Reflection 70B, DeepMind AlphaProteo

# 182 - Alexa 2.0, MiniMax, Surskever raises $1B, SB 1047 approved

#181 - Google Chatbots, Cerebras vs Nvidia, AI Doom, ElevenLabs Controversy

#180 - Ideogram v2, Imagen 3, AI in 2030, Agent Q, SB 1047

#179 - Grok 2, Gemini Live, Flux, FalconMamba, AI Scientist

#178 - More Not-Acquihires, More OpenAI drama, More LLM Scaling Talk

#177 - Instagram AI Bots, Noam Shazeer -> Google, FLUX.1, SAM2

#176 - BIG WEEK for OSS! SearchGPT, Lamma 3.1 405B, Mistral Large 2

#175 - GPT-4o Mini, OpenAI's Strawberry, Mixture of A Million Experts

#174 - Odyssey Text-to-Video, Groq LLM Engine, OpenAI Security Issues

#173 - Gemini Pro, Llama 400B, Gen-3 Alpha, Moshi, Supreme Court

#172 - Claude and Gemini updates, Gemma 2, GPT-4 Critic

#171 - Apple Intelligence, Dream Machine, SSI Inc

#170 - new Sora rival, OpenAI robotics, understanding GPT4, AGI by 2027?

#169 - Google's Search Errors, OpenAI news & DRAMA, new leaderboards

#168 - OpenAI vs Scar Jo + safety researchers, MS AI updates, cool Anthropic research

#167 - GPT-4o, Project Astra, Veo, OpenAI Departures, Interview with Andrey

#166 - new AI song generator, Microsoft's GPT4 efforts, AlphaFold3, xLSTM, OpenAI Model Spec

#165 - Sora challenger, Astribot's S1, Med-Gemini, Refusal in LLMs

#164 - Meta AI, Phi-3, OpenELM, Bollywood Deepfakes

#163 - Llama 3, Grok-1.5 Vision, new Atlas robot, RHO-1, Medium ban

#162 - Udio Song AI, TPU v5, Mixtral 8x22, Mixture-of-Depths, Musicians sign open letter

#161 - Claude 3 beats GPT-4, Stability CEO resigns, DBRX, TacticAI, UN resolution on AI

#160 - Nvidia's new GPU, Microsoft pays for Inflection AI, Grok-1 open sourced, Jeremie's Action Plan

#159 - Inflection-2.5, Devin, OpenAI board update, SIMA, EU AI Act passed

#158 - Claude 3, Elon Musk sues OpenAI, StarCoder 2, AI-Generated Spam

#157 - Gemini controversy, new Mistral models, Deepmind's Genie & Griffinn, AI Warfare is here

#156 - OpenAI's Sora, Gemini 1.5, BioMistral, V-JEPA, AI Task Force, Fun!

#155 - ChatGPT memory, Altman seeks trillions, Califonia AI regulation, art gen lawsuit

#154 - Google Gemini, Waymo Collision, Smaug-72B, EU AI Act final text, image watermarks

#153 - Taylor Swift Deepfakes, ChatGPT features, Meta-Prompting, two new US bills

#152 - live translation on phones, Meta aims at AGI, AlphaGeometry, political deepfakes

#151 - Copilot Pro, LLama.cpp, conversational diagnostic AI, secret AI diplomacy

#150 - GPT Store, new Nvidia chips, DeepMind’s robotics progress, bad uses of AI

#149 - Reflecting on 2023, Midjourney v6, Anthropic Revenue, Unified-IO 2, NY Times sues OpenAI

#148 - Imagen 2, Midjourney on web, FunSearch, OpenAI ‘Preparedness Framework’, campaigning voice clone

#147 - Google’s Gemini, EU AI Act Deal, Mixtral of Experts, Meta’s ‘Seamless’ translator

#146 - ChatGPT’s 1 year anniversary, DeepMind GNoME, Extraction of Training Data from LLMs, AnyDream

#145 - OpenAI’s Q*, Claude 2.1, Stable Video Diffusion, Starling-7B, Orca 2, international agreements

#144 - OpenAI CEO UN-FIRED, Cruise founders quit, Meta video editing, LLMs can lie, policy updates

#143 - OpenAI CEO FIRED, Cruise halts driving, xAI’s Grok, DeepMind defines AGI, actor strike over

#142 - Humanoid Robots, Video-To-Text, Habitat 3.0, Cruise troubles, data poisoning

#141 - Adobe AI upgrades, Ernie 4.0, TimeGPT, No Fakes Act, AI drones