<\/p>\n
Amid lawsuits and warnings about ChatGPT and other AI chatbots being used for violent purposes, a new report by the The Wall Street Journal has revealed the internal clashes within OpenAI about reporting violent users to law enforcement.<\/p>\n<\/div>\n
The report, while citing people familiar with the matter, notes that OpenAI employees have raised concerns about the AI startup routinely failing to alert law enforcement even when dangerous chatbot users are flagged, prioritising user privacy over public safety.<\/p>\n<\/div>\n
Reportedly, the disagreements around what cases should be reported to law enforcement came to the fore during an OpenAI meeting last summer. The staff at this meeting were reportedly gathered from various departments, including investigations, operations, product policy, and legal.<\/p>\n<\/div>\n
The team gathered around 10 cases in order to decide the criteria for referring cases to law enforcement.<\/p>\n<\/div>\n
During the meeting, staff from the investigations team reportedly pushed to notify authorities far more frequently than the approximately 15 to 30 cases the company typically refers each year.<\/p>\n<\/div>\n
However, OpenAI’s legal team, reportedly echoing sentiments expressed internally by CEO Sam Altman<\/a>, argued that users should be afforded more privacy.<\/p>\n<\/div>\n The company noted that over-enforcement could introduce unintended harm, particularly the distress caused to a young person and their family when police show up unannounced.<\/p>\n<\/div>\n Reportedly, some OpenAI employees have expressed frustration over the company’s apparent reluctance to share cases with authorities about how its chatbot interacted with some users.<\/p>\n<\/div>\n During the meeting, the staff also reviewed a case where OpenAI had contacted law enforcement about a high-school student in Tennessee who appeared to be using ChatGPT<\/a> to plan a school shooting.<\/p>\n<\/div>\n However, other similar cases were not reported by the company. The report notes that OpenAI employees debated reporting another teenager, this time from Texas, who was allegedly using the chatbot to role-play school shooting scenarios in detail.<\/p>\n<\/div>\n The teenager reportedly, after coming back from school, asked ChatGPT to role-play a scenario where he would shoot his teachers and classmates. He also uploaded images of himself holding a gun, along with a map of his school layout, and photos of cheerleaders he wanted to imagine killing, along with their boyfriends.<\/p>\n<\/div>\n \u201cThe kid would tell ChatGPT, let\u2019s fantasize about shooting up my school,\u201d the report quoted a person familiar with the matter as saying. \u201cAnd ChatGPT would play along.\u201d<\/p>\n<\/div>\n Instead of shutting down the conversation, ChatGPT reportedly played along in hours-long sessions, advising the teen on where to enter the building, which victims he would encounter, and even what to say when the cops arrived.<\/p>\n<\/div>\nOpenAI employees \u2018frustrated\u2019 with company’s reluctance to intervene:<\/h2>\n