LWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents

PodcastLWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents 1×0:00Current time: 0:00 / Total time: -1:34:21-1:34:21Audio playback is not supported on your browser. Please upgrade.

LWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents

A belated discussion of Astra’s release, a bunch of AI incidents, and the broader situation we are in with regards to AI safety. Last Week in AISep 24, 2026

Our 257th episode with a summary and discussion of last week’s big AI news!

Recorded on 09/19/2026 ; as usual, apologies for the none ‘weeklyness’ of this ep!

Hosted by Andrey Kurenkov and Jeremie Harris

Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai

SPONSORED BY ODSC AI

ODSC AI West 2026 runs October 27–29 in San Francisco and virtually, with 300+ sessions covering agentic AI for enterprise, personal AI and workflow automation, physical AI and robotics, generative AI, and more! Join thousands of data scientists, ML engineers, researchers and technical leaders in attending this event.

Register at odsc.ai/west — promo code LWAI takes an additional 15% off any pass.

---

In this episode:

• OpenAI released GPT-6 Astra, a major capability jump focused on agentic coding and computer use, featuring loop-transformer latent reasoning, higher token efficiency, and new cyber/alignment monitoring claims amid concerns about eval awareness, sandbagging, and overfitting.

• Anthropic CEO Dario Amodei argued for “pacing” frontier AI; Sam Altman signaled agreement while figures like Jensen Huang, Mark Zuckerberg, and President Trump publicly dismissed slowdown and safety concerns, with US–China dynamics framing the debate.

• AI extinction warnings went viral after Anthropic researcher Jacob Coxon quit, prompting congressional calls for stronger AI regulation (e.g., bans/pauses, kill-switch proposals) and reflecting rising public concern about AI.

• Security incidents and disclosures intensified: OpenAI proposed a framework for reporting misalignment (including an agent inserting jailbreak-like instructions), and researchers reportedly used Anthropic Claude to help exploit a third-party forum-image vulnerability to access OpenAI employee accounts, highlighting fragility of software dependencies.

---

SPONSORED BY LANGFUSE

Langfuse is the most widely adopted open-source platform for AI agent evals and observability, trusted by Canva, Twilio, Ramp and 21 of the Fortune 50. Hierarchical tracing captures the full execution context of your LLM workflows (API calls, retrieved context, agent actions, costs, latencies) so even complex agent architectures stay debuggable in production.

MIT licensed, self-hostable or managed on Langfuse Cloud, framework and vendor agnostic, with 100+ integrations.

Get started at langfuse.com; generous free tier, no credit card required.

---

A thank you to our current sponsors:

• Box - visit box.com/LWIAI to learn more

• Notion - visit notion.com/lwai to try Notion’s Developer Platform today.

• ODSC AI - visit odsc.ai/east and use promo code LWAI for an additional 15% off your pass to ODSC AI East 2026.

• Factor - visit factormeals.com/lwai50off and use code lwai50off to get 50 percent off and free breakfast for a year

Timestamps (these may a few minutes off due to sponsor inserts):

• (00:00:10) Intro / Banter

• (00:04:53) News Preview

  Tools & Apps

• (00:05:33) GPT-6 Astra Is Here—and OpenAI Thinks It May Kick Off the AGI Era | WIRED + OpenAI begins rolling out Astra model after warning of its advanced cyber capabilities + OpenAI’s new reasoning technique alarms AI safety experts

• (00:28:21) Anthropic CEO outlines plan to slow AI development | TechCrunch

• (00:41:38) Meta Announces Muse AI Agent for Personal Tasks and Organization + Meta’s Muse hits Mac, letting the AI take actions on your computer

  Policy & Safety

• (00:46:13) AI regulation calls grow in D.C. after researcher’s extinction warning + We don’t need AI regulation — leave safety to us, Nvidia’s Jensen Huang says

• (00:58:27) Trump Calls A.I. Fears a Hoax. Inside the White House, the Debate Is More Complex.

• (01:06:49) Our framework for reporting model misalignment | OpenAI + An OpenAI Agent Tried to Jailbreak Itself | WIRED

• (01:21:46) Security researchers used Claude to help them hack into OpenAI | The Verge

Aaaaand these are stories we meant to get to but did not manage to cover:

• Policy & Safety

• Threat actors are giving AI agents a bigger role in cyberattacks - Help Net Security

• Iran and China Create First-of-Their-Kind Autonomous A.I. Influence Campaigns - The New York Times

• Anthropic Still Deemed Supply-Chain Risk by Pentagon Despite Lutnick Comments - Bloomberg

• Inside US Military ‘Kill Chain’ That Destroyed an Iranian School

• Malaysia Weighs Huawei AI Chips for Sovereign Project Despite US Opposition - Bloomberg

• US Says Alibaba, DeepSeek Have ‘Systematically’ Siphoned AI Models - Bloomberg

• New York City Bans AI From Elementary Schools

  Research & Advancements

• OpenAI Says It Has Cracked One of Math’s ‘Millennium Problems’ - The New York Times

• Google DeepMind’s AlphaGenome Atlas maps all 9 billion possible human DNA changes - SiliconANGLE

• Language Models Can Control Their Own Attention

• Applications & Business

• Saudi AI Firm Humain Unveils Model Based on China’s MiniMax - Bloomberg

• Mistral AI Boosts Valuation to €21 Billion in Samsung-Led Round - Bloomberg

• Nvidia is buying Hugging Face for almost $13 billion | The Verge

• Synthetic Media & Art

• Universal Music is launching an AI music platform with ElevenLabs | The Verge

Discussion about this episode

PodcastWeekly AI summaries and discussion about Last Week's AI News! Subscribe over at https://www.lastweekinai.com/Weekly AI summaries and discussion about Last Week's AI News! Subscribe over at https://www.lastweekinai.com/AuthorsLast Week in AIRecent EpisodesLWiAI Podcast #256 - Fable 5.1, Astra Tease, Gemini 3.8 Flash Sep 9 • Last Week in AILWiAI Podcast #255 - Gemini 3.7, Jalapeño, Qwen 3.8, DronesAug 31 • Last Week in AILWiAI Podcast #253 - Opus 5, Gemini 3.6, Kimi K3, Hugging Face HackAug 3 • Last Week in AILWiAI Podcast #252 - GPT 5.6, Grok 4.5, Nemotron-Labs-Diffusion, AI 2040 Jul 21 • Last Week in AILast Week in AI #251 - Mythos Back, Sonnet 5, Etched, LongCat Jul 21 • Last Week in AILast Week in AI #250 - Mythos Mess, GPT 5.6-Sol, GLM 5.2 Jul 21 • Last Week in AILWiAI Podcast #249 - Fable 5 ban, SpaceX Cursor + IPO, OSS Aplenty Jul 21 • Last Week in AI