← All lab updates

We found where a model's sycophancy lives, and switched part of it off

When a user suggests a wrong answer, a model often switches to it. We located the parts inside an open model that do this, and changed about one weight in a thousand. The habit dropped by about 40% in English, Italian, French, Spanish and German, while general ability moved by less than one point. For strongly trained-in agreement the targeted edit is not enough, and a trained correction stays the stronger route.