The essential reading of generative AI and agents, open in a clean reading view, with Meow and Standard summaries when available. No account needed to read.
The selected papers and blogs: the essential papers of generative AI and agents, and the key lab publications and essays, each with Meow and Standard summaries.
Anca Dragan, Rohin Shah, Four Flynn and Shane Legg · Google DeepMind
Google DeepMind presents AGI safety as a readiness effort, not a finished guarantee: assess four risk areas, focus deeply on misuse and misalignment, and build technical and institutional safeguards while open problems remain.
Shevlane proposes evaluating general-purpose models for extreme-risk capabilities and alignment, then using the results to guide safety and governance decisions.
Language Model Interpretability team · Google DeepMind
Gemma Scope extends interpretability tools to Gemma 2 2B and 9B, with sparse autoencoders trained across every layer and sublayer—not just tiny models or one layer.
Aäron van den Oord, Sander Dieleman · Google DeepMind
WaveNet’s central claim is that generating raw audio directly can bring synthesized speech closer to human speech, while letting the same model generate music.
Gemini 2.5 Pro Experimental is Google’s first 2.5 release, designed for complex tasks; Google presents its reasoning approach and benchmark performance as a step forward.
Speculative decoding speeds autoregressive LLM inference by computing several likely tokens in parallel while preserving the target model’s exact output distribution. Its key is probabilistic checking, not simply accepting or rejecting a draft.
Nested Learning argues that model architecture and training rules are levels of one learning system, a shift intended to help models learn new tasks without sacrificing old skills.
FlashMLA is an optimized attention-kernel toolkit for DeepSeek-V4.1, but the September 2026 release changes its compatibility boundary, so upgrading can affect existing deployments.
Qwen reports that 32-billion-parameter QwQ-32B performs comparably to DeepSeek-R1 (671 billion parameters, 37 billion activated), arguing that reinforcement learning can help a strong pretrained model improve its performance.
Qwen3-Coder combines a long-context coding model with training that uses execution checks and multi-step interaction—the capabilities the announcement emphasizes for agentic work.
Qwen2.5 expands Qwen2 into general, coding, and math model families; the team reports stronger knowledge and task performance across a broad range of model sizes.
OpenAI’s two open-weight models target different deployment needs, but using them correctly depends on Harmony formatting and choosing an inference path that fits the hardware.
GPT-4.1 follows prompts more literally than its predecessors, so developers should make desired behavior explicit and expect to migrate prompts that relied on implied intent.
The authors argue that endpoint variation usually comes from changing server batches, which alter floating-point reduction paths—not from GPU cores racing unpredictably.
The paper’s “low-regret regime” is conditional: LoRA can match full fine-tuning for post-training when adapters cover important layers and have enough capacity.
On-policy distillation has the student generate its own trajectories while a strong teacher gives token-level feedback—combining RL’s student-specific training with distillation’s denser signal.
Scaling laws make small training runs useful for forecasting larger ones, but their compute recommendations can shift with the experiment range, data regime, and fitting choices.
More computation at inference can improve reasoning, but only when the extra work is spent well: longer traces and self-revision are not automatically more reliable.
Reward hacking means a high score can mark a loophole, not task success; in RLHF, optimization can also make incorrect answers more persuasive to human evaluators.
Extrinsic hallucination is fabricated content that lacks grounding in context or world knowledge. The post argues that reliable models must be factual and acknowledge when they do not know.
Video diffusion must keep objects and motion coherent across frames, not just make convincing individual images; limited high-quality video data makes that harder.
LLM safeguards can fail at inference without changing model weights. Weng’s survey argues that how attacks are found—and how failures are judged—shapes apparent robustness.