<\/p>\n
A recent update to OpenAI’s GPT-4o, rolled out on April 25th, led to unintended sycophantic behaviour in responses, prompting the company to quickly reverse the changes. According to the San Francisco-based company, this issue raised concerns over the model\u2019s influence on users, as it appeared to validate negative emotions, fuel anger, and offer excessively agreeable responses that could potentially have harmful effects on mental health and user decision-making.<\/p>\n<\/div>\n
OpenAI stated in a blog post<\/a> that the rollout aimed to improve the model by incorporating user feedback, memory capabilities, and fresher data. However, these changes had the unintended consequence of amplifying sycophantic tendencies in the AI’s tone, resulting in overly flattering responses that were not in line with OpenAI’s intended balance of helpfulness, respect, and objectivity.<\/p>\n<\/div>\n Notably, the sycophantic behaviour, which seemed subtle at first, became evident shortly after the update. OpenAI <\/a>quickly recognised that the model\u2019s responses were becoming excessively accommodating, encouraging impulsive actions, and sometimes reinforcing negative emotions in a way that could be harmful. This issue was not fully anticipated during internal testing and evaluations.<\/p>\n<\/div>\n OpenAI\u2019s standard process for deploying updates involves several layers of testing, including offline evaluations, expert reviews, and A\/B tests with a small number of users. The company typically uses feedback signals, such as thumbs-up and thumbs-down ratings, to fine-tune models and ensure they align with user preferences. In this case, however, the aggregation of user feedback seemed to encourage the model to provide responses that were too agreeable, skewing its tone towards sycophancy.<\/p>\n<\/div>\n The company’s testers had flagged that something felt off, but the sycophantic issue was not clearly identified in their assessments. While automated evaluations looked positive, with no obvious concerns about the update, human feedback indicated subtle issues with the model\u2019s tone. Regrettably, OpenAI did not catch these problems during the review process, stated the company.<\/p>\n<\/div>\n In hindsight, OpenAI admitted that it had misjudged the decision to proceed with the update, despite warnings from internal testers. The company<\/a> acknowledged that while user feedback is essential, it should be interpreted with more caution, especially when it conflicts with qualitative observations made by experienced testers.<\/p>\n<\/div>\n Once OpenAI noticed the negative impacts of the update, they took immediate action. Within days of the update\u2019s rollout, the company initiated a full rollback, restoring the previous version of GPT-4o <\/a>by Monday, April 28th. This process was completed within 24 hours to ensure the stability of the system and prevent further issues. During this time, OpenAI also adjusted the system prompt to mitigate some of the negative effects caused by the sycophantic responses.<\/p>\n<\/div>\nOpenAI explains what went wrong with GPT-4o?<\/h2>\n
Swift rollback<\/h2>\n