SOXL plunges 23%, Kimi K3.1 Pro open weights, and the KV-cache memory question

Om avsnittet

Chips crush the watchlist, Moonshot opens up Kimi K3.1 Pro, and we do the math on the KV cache. Markets: SOXL down 23.35%, VGT down 4.26%, QQQ down 3.72%, VUG down 2.97%. AI news: Moonshot AI releases Kimi K3.1 Pro model weights on Hugging Face amid a widening closed-versus-open gap. Interview Tip of the Day: Estimate the KV cache memory for a 70B model at 32k context and batch 16, explain why it, not the weights, becomes the bottleneck, and show how grouped-query attention and paged attention change the math. Did You Know: Apple was about 90 days from bankruptcy in 1997, and Microsoft's $150 million investment helped keep it alive. Questions or feedback: [email protected]

Om avsnittet

Fler avsnitt

Nvidia after Jensen, QQQ slides 1.2%, and the mixture-of-experts interview

SOXL sinks 11%, Nvidia's post-Huang test, and the feature store question

SOXL sinks 12%, Google's Gemini 4 Hydrogen, and the 35% GPU utilization question

SOXL drops 4.5%, Jensen Huang exits Nvidia, and the safe LLM agent question

SOXL up 12.8%, Anthropic's IPO founder sales, and catastrophic forgetting

SOXL jumps 4.6%, Anthropic's Claude Mythos 5.2, and the prohibited-ads ML question

SOXL soars 15%, Nvidia's board probes Jensen Huang, and the RLHF vs. DPO question

SOXL slides, Anthropic files its S-1, and the model-drift interview question

SOXL sinks ~38%, OpenAI's $1.25T raise, and the 0.1% fraud-model question

SOXL jumps 17%, METR's Anthropic speed audit, and the streaming recsys question