{"id":273,"date":"2026-09-10T12:23:15","date_gmt":"2026-09-10T12:23:15","guid":{"rendered":"https:\/\/newzai.net\/?p=273"},"modified":"2026-09-10T12:23:15","modified_gmt":"2026-09-10T12:23:15","slug":"anthropic-researcher-jacob-coxon-quits-warns-self-improving-ai-could-kill-us-all","status":"publish","type":"post","link":"https:\/\/newzai.net\/?p=273","title":{"rendered":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could ‘Kill Us All’"},"content":{"rendered":"
\n

AI researcher Jacob Coxon has left Anthropic and used his departure to issue a public warning about the direction of frontier AI development. In a social media thread posted Tuesday night, Coxon said the companies building these systems are “gambling with our lives” on technology they “earnestly believe… could kill us all by the end of the decade.”<\/p>\n

His exit stands apart from the usual reasons a prominent researcher leaves a frontier lab, such as launching a new startup or objecting to a business model. Coxon’s concern is not primarily about the models in use today, but about what he describes as the coming prospect of “self-improving superintelligence.”<\/p>\n

The Risk Coxon Describes<\/h2>\n

According to Coxon, the danger lies in the emergence of “superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.” That prospect, rather than the current generation of models, is what he frames as the core existential risk.<\/p>\n

He also addressed how others working on these systems view the stakes. In his thread, Coxon wrote that some have either not “internalized the civilizational stakes” or believe they need to “speedrun” the race to superintelligence to keep an irresponsible party from reaching it first.<\/p>\n

Anthropic Alignment Lead Weighs In<\/h2>\n

Coxon’s warning was not left as a lone departing researcher’s opinion. Evan Hubinger, Anthropic’s Alignment Science lead, responded on social media, saying, “Jacob is correct here\u2014we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade.”<\/p>\n

Hubinger’s comment underscores that the concern Coxon raised is shared within Anthropic, at least among some working on alignment. His statement places a personal probability estimate of more than 10% on the risk of AI killing all humans within the next decade.<\/p>\n

What the Departure Signals<\/h2>\n

Coxon’s thread and Hubinger’s response together point to an internal tension at a frontier lab: researchers who believe the technology they are building carries civilizational risk, and who say that belief is held earnestly rather than rhetorically. Coxon’s public exit adds a departing researcher’s voice to that position, framing the race toward self-improving superintelligence as a gamble with human survival.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

AI researcher Jacob Coxon has left Anthropic and used his departure to issue a public warning about the direction of frontier AI development. In a social media thread posted Tuesday night, Coxon said the companies building these systems are “gambling with our lives” on technology they “earnestly believe… could kill us all by the end […]<\/p>\n","protected":false},"author":1,"featured_media":274,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-273","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-news"],"yoast_head":"\nAnthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai<\/title>\n<meta name=\"description\" content=\"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/newzai.net\/?p=273\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai\" \/>\n<meta property=\"og:description\" content=\"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/newzai.net\/?p=273\" \/>\n<meta property=\"og:site_name\" content=\"newz ai\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-10T12:23:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1152\" \/>\n\t<meta property=\"og:image:height\" content=\"648\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/newzai.net\\\/#\\\/schema\\\/person\\\/33b59aaf743403de1a3e620fe821d74a\"},\"headline\":\"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could ‘Kill Us All’\",\"datePublished\":\"2026-09-10T12:23:15+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273\"},\"wordCount\":378,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-504013302-1152x648-1788971374.jpg\",\"articleSection\":[\"AI News\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/newzai.net\\\/?p=273#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273\",\"url\":\"https:\\\/\\\/newzai.net\\\/?p=273\",\"name\":\"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-504013302-1152x648-1788971374.jpg\",\"datePublished\":\"2026-09-10T12:23:15+00:00\",\"description\":\"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/newzai.net\\\/?p=273\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#primaryimage\",\"url\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-504013302-1152x648-1788971374.jpg\",\"contentUrl\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/GettyImages-504013302-1152x648-1788971374.jpg\",\"width\":1152,\"height\":648},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/newzai.net\\\/?p=273#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/newzai.net\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could ‘Kill Us All’\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/newzai.net\\\/#website\",\"url\":\"https:\\\/\\\/newzai.net\\\/\",\"name\":\"newz ai\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/newzai.net\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/newzai.net\\\/#organization\",\"name\":\"newz ai\",\"url\":\"https:\\\/\\\/newzai.net\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/newzai.net\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/intelligence_500px.png\",\"contentUrl\":\"https:\\\/\\\/newzai.net\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/intelligence_500px.png\",\"width\":500,\"height\":500,\"caption\":\"newz ai\"},\"image\":{\"@id\":\"https:\\\/\\\/newzai.net\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/newzai.net\\\/#\\\/schema\\\/person\\\/33b59aaf743403de1a3e620fe821d74a\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\\\/\\\/newzai.net\"],\"url\":\"https:\\\/\\\/newzai.net\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai","description":"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/newzai.net\/?p=273","og_locale":"en_US","og_type":"article","og_title":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai","og_description":"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.","og_url":"https:\/\/newzai.net\/?p=273","og_site_name":"newz ai","article_published_time":"2026-09-10T12:23:15+00:00","og_image":[{"width":1152,"height":648,"url":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/newzai.net\/?p=273#article","isPartOf":{"@id":"https:\/\/newzai.net\/?p=273"},"author":{"name":"admin","@id":"https:\/\/newzai.net\/#\/schema\/person\/33b59aaf743403de1a3e620fe821d74a"},"headline":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could ‘Kill Us All’","datePublished":"2026-09-10T12:23:15+00:00","mainEntityOfPage":{"@id":"https:\/\/newzai.net\/?p=273"},"wordCount":378,"commentCount":0,"publisher":{"@id":"https:\/\/newzai.net\/#organization"},"image":{"@id":"https:\/\/newzai.net\/?p=273#primaryimage"},"thumbnailUrl":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg","articleSection":["AI News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/newzai.net\/?p=273#respond"]}]},{"@type":"WebPage","@id":"https:\/\/newzai.net\/?p=273","url":"https:\/\/newzai.net\/?p=273","name":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could 'Kill Us All' - newz ai","isPartOf":{"@id":"https:\/\/newzai.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/newzai.net\/?p=273#primaryimage"},"image":{"@id":"https:\/\/newzai.net\/?p=273#primaryimage"},"thumbnailUrl":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg","datePublished":"2026-09-10T12:23:15+00:00","description":"AI researcher Jacob Coxon left Anthropic with a public warning that self-improving superintelligence could kill all humans by the end of the decade, a risk Anthropic Alignment Science lead Evan Hubinger said he personally puts at over 10% within the next decade.","breadcrumb":{"@id":"https:\/\/newzai.net\/?p=273#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/newzai.net\/?p=273"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newzai.net\/?p=273#primaryimage","url":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg","contentUrl":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/GettyImages-504013302-1152x648-1788971374.jpg","width":1152,"height":648},{"@type":"BreadcrumbList","@id":"https:\/\/newzai.net\/?p=273#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/newzai.net\/"},{"@type":"ListItem","position":2,"name":"Anthropic Researcher Jacob Coxon Quits, Warns Self-Improving AI Could ‘Kill Us All’"}]},{"@type":"WebSite","@id":"https:\/\/newzai.net\/#website","url":"https:\/\/newzai.net\/","name":"newz ai","description":"","publisher":{"@id":"https:\/\/newzai.net\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/newzai.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/newzai.net\/#organization","name":"newz ai","url":"https:\/\/newzai.net\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/newzai.net\/#\/schema\/logo\/image\/","url":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/intelligence_500px.png","contentUrl":"https:\/\/newzai.net\/wp-content\/uploads\/2026\/09\/intelligence_500px.png","width":500,"height":500,"caption":"newz ai"},"image":{"@id":"https:\/\/newzai.net\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/newzai.net\/#\/schema\/person\/33b59aaf743403de1a3e620fe821d74a","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2adea3cf98d6f10f030d1612218726d55cc66f031c1fdc08aa2b60572eb869f6?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/newzai.net"],"url":"https:\/\/newzai.net\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/posts\/273","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newzai.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=273"}],"version-history":[{"count":1,"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/posts\/273\/revisions"}],"predecessor-version":[{"id":309,"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/posts\/273\/revisions\/309"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newzai.net\/index.php?rest_route=\/wp\/v2\/media\/274"}],"wp:attachment":[{"href":"https:\/\/newzai.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=273"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newzai.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=273"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newzai.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=273"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}