{"id":180543,"date":"2023-10-25T10:36:18","date_gmt":"2023-10-25T05:06:18","guid":{"rendered":"https:\/\/dripp.zone\/news\/?p=180543"},"modified":"2023-10-25T10:36:18","modified_gmt":"2023-10-25T05:06:18","slug":"artists-could-use-a-poison-pill-to-combat-ai-exploitation-crypto-news","status":"publish","type":"post","link":"https:\/\/dripp.zone\/news\/artists-could-use-a-poison-pill-to-combat-ai-exploitation-crypto-news\/","title":{"rendered":"Artists Could Use a Poison Pill to Combat AI Exploitation – Crypto News"},"content":{"rendered":"
\n

The astonishing capability of generative AI to create visual images is getting better and more accessible<\/a>, but with their models based on massive libraries of existing art, artists are frantically looking for ways to prevent their work from being harvested without their permission. A new tool, ominously named Nightshade, could be the answer.<\/p>\n

The trick involves using optimized, prompt-specific \u201cdata poisoning attacks\u201d that corrupt the data needed to train AI models when it’s fed into an image generator.<\/p>\n

\u201cPoisoning has been a known attack vector in machine learning models for years,\u201d Professor Ben Zhao told Decrypt<\/i>. \u201cNightshade is not interesting because it does poisoning, but because it poisons generative AI models, which nobody thought was possible because these models are so big.\u201d<\/p>\n

Combatting intellectual property theft and AI deepfakes has become crucial since generative AI models came into the mainstream this year. In July, a team of researchers at MIT similarly suggested injecting <\/a>small bits of code that would cause the image to distort, rendering it unusable.<\/p>\n

Generative AI<\/a> refers to AI models that use prompts to generate text, images, music, or videos. Google<\/a>, Amazon<\/a>, Microsoft<\/a>, and Meta<\/a> have all invested heavily in bringing generative AI tools to consumers.<\/p>\n

As Zhao explained, Nightshade gets around the problem of an AI model\u2019s large datasets by targeting the prompt\u2014for example, requests to create an image of a dragon, dog, or horse.<\/p>\n

\u201cAttacking the whole model makes no sense,\u201d Zhao said. \u201cWhat you do want to attack is individual prompts, debilitating the model and disabling it from generating art.\u201d<\/p>\n

To avoid detection, the research team explained, the text and image within the poisoned data must be crafted to appear natural and crafted to deceive both automated alignment detectors and human inspectors to achieve the intended effect.<\/p>\n

Although the poisonous Nightshade dataset is merely a proof of concept, Zhao said the easiest way to deceive an AI model like Stable Diffusion into thinking a cat is a dog is by simply mislabeling a few hundred images of a cat as a dog.<\/p>\n

Even without any coordination, artists could begin implementing these poison pills en masse, and it could cause the AI model to collapse.<\/p>\n

\u201cOnce enough attacks become active on the same model, the model becomes worthless,\u201d Zhao said. \u201cBy worthless, I mean, you give it things like \u2018give me a painting,\u2019 and it comes out with what looks like a kaleidoscope of pixels. The model is effectively dumbed down to the version of something akin to a random pixel generator.\u201d<\/p>\n

Zhao said Nightshade does not require any action be taken against the AI image generator itself but takes effect when the AI model attempts to consume the data that Nightshade has been included in.<\/p>\n

\u201cIt does nothing to them unless they take those images and put them into the training data,\u201d he said, calling it less of an attack and more like self-defense or a barbed wire fence with poison tips aimed at AI developers who do not respect opt-out requests and do-not-scrape directives.<\/p>\n

\u201cThis is designed to solve that problem,\u201d Zhao said. \u201cSo we had this barbed wire sting with some poison. Unless you run around and get this stuff all over, you won’t suffer.\u201d<\/p>\n

Edited by Ryan Ozawa<\/a>.<\/i><\/p>\n

\n
<\/p>\n

Stay on top of crypto news, get daily updates in your inbox.<\/h3>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

The astonishing capability of generative AI to create visual images is getting better and more accessible, but with their models based on massive libraries of existing art, artists are frantically looking for ways to prevent their work from being harvested without their permission. A new tool, ominously named Nightshade, could be the answer. The trick […]<\/p>\n","protected":false},"author":2,"featured_media":180544,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[230,225,221,227,226,228,229,60,223,224,222],"class_list":["post-180543","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cryptocurrency","tag-brave","tag-coinbase","tag-crypto","tag-decentralised","tag-decentralized","tag-decentralized-exchange","tag-erc-20","tag-featured","tag-meme-coin","tag-robinhood","tag-solana"],"_links":{"self":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/180543","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/comments?post=180543"}],"version-history":[{"count":2,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/180543\/revisions"}],"predecessor-version":[{"id":180548,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/180543\/revisions\/180548"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media\/180544"}],"wp:attachment":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media?parent=180543"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/categories?post=180543"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/tags?post=180543"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}