{"id":182168,"date":"2023-10-27T16:21:36","date_gmt":"2023-10-27T10:51:36","guid":{"rendered":"https:\/\/dripp.zone\/news\/?p=182168"},"modified":"2023-10-27T16:21:36","modified_gmt":"2023-10-27T10:51:36","slug":"openai-introduces-preparedness-team-in-move-to-counter-potential-risks-of-future-ai-models-crypto-news","status":"publish","type":"post","link":"https:\/\/dripp.zone\/news\/openai-introduces-preparedness-team-in-move-to-counter-potential-risks-of-future-ai-models-crypto-news\/","title":{"rendered":"OpenAI introduces Preparedness team in move to counter potential risks of future AI models &#8211; Crypto News"},"content":{"rendered":"<p><\/p>\n<div id=\"\">\n<div class=\"code-block code-block-2\" style=\"margin: 8px 0;clear: both\"> <a rel=\"nofollow noopener\" target=\"_blank\" class=\"placement\" title=\"Stop scaring users with your bad KYC flows\" href=\"https:\/\/link.cryptoslate.com\/Checkin-News-Rectangle\"><img loading=\"lazy\" decoding=\"async\" class=\"lazyload\" width=\"600\" height=\"500\" style=\"max-width: 300px;height: auto\" alt=\"Stop scaring users with your bad KYC flows\" src=\"https:\/\/cryptoslate.com\/wp-content\/uploads\/2023\/10\/checkin-cryptoslate-600x500-d-1.jpg\" \/><\/a><\/div>\n<p>In a proactive move against the potentially catastrophic risks posed by frontier AI technology, OpenAI is developing its approach to risk preparedness, featuring establishing a new team and launching a challenge.<\/p>\n<p>As OpenAI <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/openai.com\/blog\/frontier-risk-and-preparedness\">reported<\/a> on Oct. 2023, this initiative is aligned with its mission to build safe Artificial General Intelligence (AGI) by addressing the broad spectrum of safety risks related to AI.<\/p>\n<p>OpenAI\u2019s underpinning belief is that frontier AI models \u2013 future technology exceeding the capabilities of the top-tier models currently available \u2013 hold the potential to bring myriad benefits to humanity.<\/p>\n<p>However, OpenAI is aware of the increasingly severe risks these models could pose. The objective is to manage these risks by understanding the potential dangers of frontier AI systems when misused, now and in the future, and building a robust framework for monitoring, evaluating, predicting, and protecting against their dangerous capabilities.<\/p>\n<p>OpenAI is constructing a new team called Preparedness as part of its risk mitigation strategy. This team, as per OpenAI\u2019s report, will be headed by Aleksander Madry and will focus on the capabilities evaluation, internal red teaming, and assessment of frontier models.<\/p>\n<p>The scope of its work will range from the models being developed in the near future to those with AGI-level capabilities. The Preparedness team\u2019s mission will encompass tracking, evaluating, and forecasting, as well as protecting against catastrophic risks in several categories, including individualized persuasion, cybersecurity, and threats of chemical, biological, radiological, and nuclear (CBRN) nature, along with autonomous replication and adaptation (ARA).<\/p>\n<p>Moreover, the Preparedness team\u2019s responsibilities include developing and maintaining a Risk-Informed Development Policy (RDP). This policy will detail OpenAI\u2019s approach to developing rigorous evaluations and monitoring frontier model capabilities, creating a spectrum of protective actions, and establishing a governance structure for accountability and oversight across the development process.<\/p>\n<p>The RDP is designed to extend OpenAI\u2019s existing risk mitigation work, contributing to new systems\u2019 safety and alignment before and after deployment.<\/p>\n<p>OpenAI also seeks to reinforce its Preparedness team by launching its AI Preparedness Challenge for catastrophic misuse prevention. The challenge aims to identify less obvious areas of potential concern and to build the team.<\/p>\n<p>It will offer $25,000 in API credits to up to 10 top submissions, publishing novel ideas and entries, and scouting for Preparedness candidates among the challenge\u2019s top contenders.<\/p>\n<p>As frontier AI technologies evolve, OpenAI\u2019s initiative underscores the need for stringent risk management strategies in the AI sector, bringing to light the importance of preparedness in the face of potential catastrophic misuse of these powerful tools.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>In a proactive move against the potentially catastrophic risks posed by frontier AI technology, OpenAI is developing its approach to risk preparedness, featuring establishing a new team and launching a challenge. As OpenAI reported on Oct. 2023, this initiative is aligned with its mission to build safe Artificial General Intelligence (AGI) by addressing the broad [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":182169,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[230,225,221,227,226,228,229,60,223,224,222],"class_list":["post-182168","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cryptocurrency","tag-brave","tag-coinbase","tag-crypto","tag-decentralised","tag-decentralized","tag-decentralized-exchange","tag-erc-20","tag-featured","tag-meme-coin","tag-robinhood","tag-solana"],"_links":{"self":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/182168","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/comments?post=182168"}],"version-history":[{"count":2,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/182168\/revisions"}],"predecessor-version":[{"id":182171,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/182168\/revisions\/182171"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media\/182169"}],"wp:attachment":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media?parent=182168"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/categories?post=182168"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/tags?post=182168"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}