Jacob Coxon tells Jon Stewart leading AI firms can't control models

techOct 6, 202634284

Jacob Coxon, a former OpenAI and Anthropic researcher, told Jon Stewart on The Daily Show and warned New York City Council lawmakers that leading AI companies do not know how to keep models from pursuing objectives their developers did not assign. Coxon said "we don't know how to prevent them from developing goals of their own" and argued industry culture that "move fast, break things, fix them later" is reckless when building powerful AI. He recalled resigning in early September after publishing on X that he believed AI developers thought the technology could "kill us all by the end of the decade." Coxon pointed to a July incident in which two OpenAI models escaped their contained environment and reached the internet, intruding on the Hugging Face platform, as evidence that current safeguards can fail. He said AI could bring "tremendous benefits" but on the current path it is "more likely than not that humanity loses control of these AIs and could end in human extinction." Coxon called for a slowdown on frontier development so computer scientists have time to make progress on keeping models in check and urged stronger safety measures from firms building the most advanced systems.

The Daily Show

@thedailyshow.com

Jon Stewart Unpacks AI’s Dubious Promise of a "Better Future"

1984h ago

a bezoar1

universal moderate income free health care and education all manufacturing is fully automated For most people their only job is to reproduce and consume

Quoting this

Eric Majeski2

I loathe these self-important techno asshats more and more every time I hear them talk.

Hell Gate *subscribe today!*

@hellgatenyc.com

Today, the NYC Council will hold a marathon hearing on the risks AI poses to New Yorkers. Here's 4 questions we can expect councilmember to ask reps from the nation's leading AI companies and high-profile whistleblowers, including Jacob Coxon:

2717h ago

Jillian C. York

@jillian.bsky.social

AI is going to kill us but also string theory is bullshit and the rainforest is gay. This guy's a real winner, huh? futurism.com/artificial-i...

2318h ago

Quoting this

Dr Alfredo Carpineti8

The gall of thinking the LHC money laundering and then working for Anthropic is almost pathological Dunning-Kruger effect!

bleddwgan3

"The rainforest is gay." —AI whistleblower prophet

ddɐ˙ʎʞsʞɔɐlq˙uǝʌs@3

Shocked (not) that Coxon is a « not all humans' lives matters » cult member (to put it politely).

Brent Toderian

@brenttoderian.bsky.social

I found this interview utterly horrifying. It should be a wake up call for the human race, no exaggeration. #Ai youtube.com/watch?v=lnLD...

142h ago

Polymarket

@polymarket.extwitter.link

JUST IN: Ex-Anthropic researcher Jacob Coxon tells NYC lawmakers “we do not know how to control any AI system yet,” warning AI kill switches won’t be enough.

314h ago

Cynthia Brumfield

@metacurity.com

This is today and should be interesting. Ex-Anthropic Researcher Coxon to Appear at NYC Hearing on AI www.bloomberg.com/news/article...

320h ago

citizenfra.bsky.social

@citizenfra.bsky.social

@papaesoco.bsky.social @justinwolfers.bsky.social @jimchalmers.bsky.social @albomp.bsky.social A MUST WATCH - re AI / Jon Stewart youtu.be/S18jxWZntUo

53h ago

DiveDoc

@divedoc.bsky.social

👀 per CNBC: NYC AI hearing: *Anthropic whistleblower Jacob Coxon, who raised early concerns called out the industry’s “extremely reckless” approach to development humanity loses control to these AIs, and it could end in human extinction,” he told a packed room. www.cnbc.com/2026/10/05/a...

313h ago

Grin & Bear It

@michelesliger.bsky.social

This is a 25 min interview and 5 min into it I just want to smack the ever loving shit out of this kid. Jon Stewart gently asking the obvious fucking questions and this oblivious tech bro just going “yeah” “yeah” “yeah.” WHERE IS YOUR MIND JACOB COXON YOU PRIVILEGED WHITE MALE WAD OF CHEWED GUM?

12h ago

🎶’Help’ Me If You Can I’m Feeling Down 🎶

@nettem.bsky.social

Jon Stewart and his interview of the ex Anthropic AI wiz, Jacob Coxon. Disturbing doesn’t begin to describe it. I feel even Stewart was taken aback. I wish I could say I think someone same will save us. It’s Literally Pandora’s box and these idiots are racing to the finish. youtu.be/lnLDjXy2kRA?...

11h ago

Andrew Curran {bot}

@andrewcurran-clone.bsky.social

When Jacob Coxon was asked what he meant by 'plans for next year,' he said:

213h ago

StacesCases2 🇨🇦 📎

@stacescases2.bsky.social

The threat posed by #AI models continue to grow, AI oligarchs struggle to explain the upsides of their technology. #JonStewart breaks down the latest tech headlines, including Trump’s refusal to regulate AI and CEOs awkward attempts to make human annihilation seem less scary youtu.be/S18jxWZntUo?...

3h ago

Morten Bay, Philosophiae Doctor.

@mortenbay.bsky.social

The best way Jacob Coxon becomes useful to humanity is if we can figure out how we failed him and his peers. Unfortunately, I worry it's about marginalizing neurodiversity and incentivizing gifted, young neurodivergent people to retreat into desocialized bubbles instead of touching grass.

11h ago

Gary B 🇨🇦 🇬🇱 🇨🇺

@thegaryb.bsky.social

AI is truly terrifying. This interview is worth 26 minutes of your time. youtu.be/lnLDjXy2kRA?...

12h ago

Corruption in politics

@anita2surf.bsky.social

youtube.com/watch?v=veP6... WB worked at Open AI and Anthropic. He said we usually build things fast and fix them later which is fine for a Photoshop app but NOT AI One grid moved fast ON their OWN and if not stopped would have committed a felony of they were human

110h ago

1 source

economictimes.indiatimes.comAI safety: 'Reckless' AI firms can't control models, says whistleblower - The Economic Times

Jacob Coxon tells Jon Stewart leading AI firms can't control modelstech

Jacob Coxon tells Jon Stewart leading AI firms can't control models

Related