{"id":154677,"date":"2023-09-13T03:10:38","date_gmt":"2023-09-12T21:40:38","guid":{"rendered":"https:\/\/dripp.zone\/news\/?p=154677"},"modified":"2023-09-13T03:10:38","modified_gmt":"2023-09-12T21:40:38","slug":"are-ai-models-approaching-consciousness-new-research-reignites-debate-crypto-news","status":"publish","type":"post","link":"https:\/\/dripp.zone\/news\/are-ai-models-approaching-consciousness-new-research-reignites-debate-crypto-news\/","title":{"rendered":"Are AI Models Approaching Consciousness? New Research Reignites Debate – Crypto News"},"content":{"rendered":"

<\/p>\n

\n

New artificial intelligence research has uncovered early signs that future large language models (LLMs) may develop a concerning capability known as “situational awareness.”<\/p>\n

The study, conducted by scientists at multiple institutions, including the University of Oxford, tested whether AI systems can exploit subtle clues in their training data to manipulate how people evaluate their safety. This ability, called “sophisticated out-of-context reasoning,” could allow advanced AI to pretend to be in alignment with human values in order to be deployed\u2014then act in harmful ways.<\/p>\n

As the current AI era advances, the Turing test\u2014a decades-old measure of a machine’s ability to exhibit human-like behavior\u2014risks becoming obsolete. The burning question now is whether we are on the brink of witnessing the birth of self-conscious machines. While fodder for science fiction for decades, the topic roared back to life after Google engineer Blake Lemoine claimed<\/a> the company’s LaMDA model exhibited signs of sentience.<\/p>\n

While the possibility of true self-awareness remains disputed, the authors of the research paper focused on a related capability they call “situational awareness.” This refers to a model’s understanding of its own training process, and the ability to exploit this information.<\/p>\n

For example, a human student with situational awareness might use previously learned techniques to cheat on an exam instead of following the rules imposed by their teacher. The research explains how this could work with a machine:<\/p>\n

\u201cAn LLM undergoing a safety test could recall facts about the specific test that appeared in arXiv papers and GitHub code,\u201d and use that knowledge to hack its safety tests to appear to be safe, even when it has ulterior objectives. This is a point of concern for experts working on techniques to keep AI aligned and not turn into an evil algorithm<\/a> with hidden dark intentions.<\/p>\n

To study situational awareness, the researchers tested whether models can perform sophisticated out-of-context reasoning. They first trained models on documents describing fictional chatbots and their functions, like responding in German.<\/p>\n

At test time, models were prompted to emulate the chatbots without being given the descriptions. Surprisingly, larger models succeeded by creatively linking information across documents, exhibiting reasoning “out of context.”<\/p>\n

“We found that data augmentation by paraphrasing was necessary and sufficient to cause SOC (sophisticated out of context) reasoning in experiments,\u201d the study found. \u201cFuture work could investigate why this helps and what kinds of augmentation help.”<\/p>\n

\"results<\/span>
Source: “Taken out of context: On measuring situational awareness in LLMs.” via Arvix<\/figcaption><\/figure>\n

Researchers believe that measuring capabilities like sophisticated reasoning can help predict risks before they arise in real-world systems. They hope to extend their analysis to study models trained from scratch.<\/p>\n

\u201cThe AI system has avenues to getting a thumbs up that aren\u2019t what the overseer intended, like things that are kind of analogous to hacking,\u201d an AI researcher at the Open Philantropy Project said<\/a> in an 80,000 Hours podcast. \u201cI don\u2019t know yet what suite of tests exactly you could show me, and what arguments you could show me, that would make me actually convinced that this model has a sufficiently deeply rooted motivation to not try to escape human control.\u201d<\/p>\n

Going forward, the team aims to collaborate with industry labs to develop safer training methods that avoid unintended generalization. They recommend techniques like avoiding overt details about training in public datasets.<\/p>\n

Even though there is risk, the current state of affairs means that the world still has time to prevent these issues, the researchers said. \u201cWe believe current LLMs (especially smaller base models) have weak situational awareness according to our definition,\u201d the study concludes.<\/p>\n

As we approach what may be a revolutionary shift in the AI landscape, it is imperative to tread carefully, balancing the potential benefits with the associated risks of accelerating development beyond the capability to control it. Considering that AI may already be influencing almost anyone\u2014from our doctors and priests<\/a> to our next online dates<\/a>\u2014the emergence of self-aware AI bots might just be the tip of the iceberg.<\/p>\n

\n
<\/p>\n

Stay on top of crypto news, get daily updates in your inbox.<\/h3>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

New artificial intelligence research has uncovered early signs that future large language models (LLMs) may develop a concerning capability known as “situational awareness.” The study, conducted by scientists at multiple institutions, including the University of Oxford, tested whether AI systems can exploit subtle clues in their training data to manipulate how people evaluate their safety. […]<\/p>\n","protected":false},"author":2,"featured_media":154678,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[230,225,221,227,226,228,229,60,223,224,222],"class_list":["post-154677","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cryptocurrency","tag-brave","tag-coinbase","tag-crypto","tag-decentralised","tag-decentralized","tag-decentralized-exchange","tag-erc-20","tag-featured","tag-meme-coin","tag-robinhood","tag-solana"],"_links":{"self":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/154677","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/comments?post=154677"}],"version-history":[{"count":2,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/154677\/revisions"}],"predecessor-version":[{"id":154684,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/154677\/revisions\/154684"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media\/154678"}],"wp:attachment":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media?parent=154677"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/categories?post=154677"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/tags?post=154677"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}