{"id":412947,"date":"2025-12-02T22:47:31","date_gmt":"2025-12-02T17:17:31","guid":{"rendered":"https:\/\/dripp.zone\/news\/anthropic-co-founder-warns-ai-may-design-its-own-successor-says-humans-face-a-big-decision-before-2030-crypto-news\/"},"modified":"2025-12-02T23:17:21","modified_gmt":"2025-12-02T17:47:21","slug":"anthropic-co-founder-warns-ai-may-design-its-own-successor-says-humans-face-a-big-decision-before-2030-crypto-news","status":"publish","type":"post","link":"https:\/\/dripp.zone\/news\/anthropic-co-founder-warns-ai-may-design-its-own-successor-says-humans-face-a-big-decision-before-2030-crypto-news\/","title":{"rendered":"Anthropic co-founder warns AI may design its own successor, says humans face a \u2018big decision\u2019 before 2030 – Crypto News"},"content":{"rendered":"

<\/p>\n

\n

Artificial general intelligence or superintelligence has been one of the most widely cited terms in the world of AI but there is hardly any consensus on what it means or what its possible implications could be for society. That being said, leading AI labs like OpenAI, Google and Anthropic are racing to be the first to create a model that could reach AGI status.<\/p>\n<\/div>\n

\n

However, Anthropic<\/a> co founder and Chief Scientist Jared Kaplan, in an interview with the Guardian, explained that humanity will have \u201cthe biggest decision\u201d on whether it takes the \u201cultimate risk\u201d of letting AI systems train themselves to become more powerful.<\/p>\n<\/div>\n

\n

As per Kaplan, the period between 2027 and 2030 may become the moment when artificial intelligence becomes capable of designing its own successors.<\/p>\n<\/div>\n

\n

The Anthropic executive says that he is very optimistic about the alignment of AI tools with the interests of humanity up to the level of human intelligence but not when it exceeds that threshold.<\/p>\n<\/div>\n

\n

Kaplan on AI training its successor<\/h2>\n

The moment an AI system begins training its own successor, the guardrails that AI labs currently have on their models may no longer be enough. Kaplan believes it could lead to an intelligence explosion and may even be the moment when humans lose control over the AI.<\/p>\n<\/div>\n

\n

\u201cIf you imagine you create this process where you have an AI that is smarter than you, or about as smart as you, it\u2019s then making an AI that\u2019s much smarter. It\u2019s going to enlist that AI\u2019s help to make an AI smarter than that. It sounds like a kind of scary process. You don\u2019t know where you end up,\u201d he told the Guardian.<\/p>\n<\/div>\n

\n

In such a scenario, the AI black box problem would become absolute, where humans would not just be unsure why the AI made a decision but would not even be able to tell where the AI is going.<\/p>\n<\/div>\n

\n

\u201cThat\u2019s the thing that we view as maybe the biggest decision or scariest thing to do\u2026 once no one\u2019s involved in the process, you don\u2019t really know. You can start a process and say, \u2018Oh, it\u2019s going very well. It\u2019s exactly what we expected. It\u2019s very safe.\u2019 But you don\u2019t know \u2013 it\u2019s a dynamic process. Where does that lead?\u201d he noted.<\/p>\n<\/div>\n

\n

Kaplan says there are two major risks in such a scenario. First, will humans lose control over the AI<\/a> and will they continue to have agency in their lives?<\/p>\n<\/div>\n

\n

\u201cOne is do you lose control over it? Do you even know what the AIs are doing? The main question there is: are the AIs good for humanity? Are they helpful? Are they going to be harmless? Do they understand people? Are they going to allow people to continue to have agency over their lives and over the world?\u201d Kaplan noted.<\/p>\n<\/div>\n

\n

The second risk is when the speed of improvement of self taught AIs goes beyond human scientific research and technological development capabilities.<\/p>\n<\/div>\n

\n

\u201cIt seems very dangerous for it to fall into the wrong hands\u2026 You can imagine some person deciding: \u2018I want this AI to just be my slave. I want it to enact my will.\u2019 I think preventing power grabs, preventing misuse of the technology, is also very important,\u201d he said.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Artificial general intelligence or superintelligence has been one of the most widely cited terms in the world of AI but there is hardly any consensus on what it means or what its possible implications could be for society. That being said, leading AI labs like OpenAI, Google and Anthropic are racing to be the first […]<\/p>\n","protected":false},"author":2,"featured_media":412949,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[9379,440,43286,12702,13778,284,188,183,5834,185,186,5067,187,184,189,150,182,190],"class_list":["post-412947","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-agi","tag-ai","tag-ai-anthropic","tag-anthropic","tag-anthropic-ai","tag-artificial-intelligence","tag-blockchain-tech","tag-blockchain-technology","tag-chatgpt","tag-crypto-technology","tag-cryptocurrency-technology","tag-gemini","tag-metaverse-technology","tag-nft-technology","tag-soul-bound-token","tag-tech","tag-technology","tag-token-technology"],"_links":{"self":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/412947","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/comments?post=412947"}],"version-history":[{"count":1,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/412947\/revisions"}],"predecessor-version":[{"id":412950,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/412947\/revisions\/412950"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media\/412949"}],"wp:attachment":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media?parent=412947"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/categories?post=412947"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/tags?post=412947"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}