{"id":147346,"date":"2026-09-17T12:10:00","date_gmt":"2026-09-17T16:10:00","guid":{"rendered":"https:\/\/kendallharmon.net\/?p=147346"},"modified":"2026-09-17T17:59:08","modified_gmt":"2026-09-17T21:59:08","slug":"nyt-the-liftoff-scenario-that-terrifies-a-i-doomsayers","status":"publish","type":"post","link":"https:\/\/kendallharmon.net\/?p=147346","title":{"rendered":"(NYT) The Liftoff Scenario That Terrifies A.I. Doomsayers"},"content":{"rendered":"\n<p>In December, Edward Hughes and Louis Kirsch, two of the world\u2019s leading artificial intelligence researchers, left Google. Their goal: to build an A.I. system smart enough to build a better A.I. system.<\/p>\n\n\n\n<p>At their new London start-up, Inherent, they now spend their days working alongside a prototype called Faraday. Named for the 19th-century English physicist Michael Faraday, it gathers mountains of data capturing the daily activities of Dr. Hughes, Dr. Kirsch and Inherent\u2019s other researchers: emails, instant messages, meeting transcripts and their ongoing chats with Faraday itself. The company then uses this data to build a better version of Faraday.<\/p>\n\n\n\n<p>\u201cFaraday has access to everything that goes on at the company,\u201d Dr. Hughes said. \u201cWe want to give it data describing the process we go through, to discover something.\u201d<\/p>\n\n\n\n<p>Though Inherent pledges to keep humans involved in this elaborate process, many other companies are building similar technology, and some leading researchers believe A.I. systems will eventually be powerful enough to improve themselves with little or no help from human developers \u2014 a mind-bending goal that computer scientists call recursive self-improvement, or R.S.I.<\/p>\n\n\n\n<p>Two Silicon Valley start-ups \u2014 each valued\u00a0<a href=\"https:\/\/www.nytimes.com\/2026\/01\/26\/technology\/recursive-ai-ricursive.html\">at $4 billion<\/a>\u00a0\u2014 are proudly pursuing this dream, and leading labs like OpenAI and Anthropic are chasing it too. They hope to accelerate the development of artificial intelligence that\u00a0<a href=\"https:\/\/www.nytimes.com\/2026\/09\/07\/science\/ai-generated-drug-longevity.html\">discovers drugs<\/a>,\u00a0<a href=\"https:\/\/www.nytimes.com\/2025\/09\/30\/technology\/ai-meta-google-openai-periodic.html\">creates new materials<\/a>, speeds other forms of scientific discovery and, one day,\u00a0<a href=\"https:\/\/www.nytimes.com\/2025\/05\/16\/technology\/what-is-agi.html\">surpasses human intelligence in practically every way<\/a>.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.nytimes.com\/2026\/09\/16\/science\/ai-recursive-self-improvement.html\">Read it all<\/a>.<\/p><blockquote class=\"twitter-tweet\"><p lang=\"en\" dir=\"ltr\">The Liftoff Scenario That Terrifies A.I. Doomsayers: \u201cRecursive self-improvement\u201d is the idea that artificial intelligence could learn to build &amp; train itself, creating exponential new progress \u2014 &amp; risk (NYT) <a href=\"https:\/\/t.co\/y5RXO0VbEu\">https:\/\/t.co\/y5RXO0VbEu<\/a><\/p>&mdash; Candice Rose (@CandiceRose) <a href=\"https:\/\/x.com\/CandiceRose\/status\/2100307804141576459?ref_src=twsrc%5Etfw\">September 16, 2026<\/a><\/blockquote> <script async src=\"https:\/\/platform.x.com\/widgets.js\" charset=\"utf-8\"><\/script>\n","protected":false},"excerpt":{"rendered":"<p>In December, Edward Hughes and Louis Kirsch, two of the world\u2019s leading artificial intelligence researchers, left Google. Their goal: to build an A.I. system smart enough to build a better A.I. system. At their new London start-up, Inherent, they now<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/kendallharmon.net\/?p=147346\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":794,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39,175,168,133,95],"tags":[],"class_list":["post-147346","post","type-post","status-publish","format-standard","hentry","category-culture-watch","category-anthropology","category-ethics-moral-theology","category-history","category-science-technology"],"_links":{"self":[{"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/posts\/147346","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/users\/794"}],"replies":[{"embeddable":true,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=147346"}],"version-history":[{"count":5,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/posts\/147346\/revisions"}],"predecessor-version":[{"id":147351,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=\/wp\/v2\/posts\/147346\/revisions\/147351"}],"wp:attachment":[{"href":"https:\/\/kendallharmon.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=147346"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=147346"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kendallharmon.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=147346"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}