← All lab updates

Jailbreaks in slow motion: attacks spread over many messages, and the trade-off in stopping them

The hardest jailbreaks never ask for the harmful thing at once: they get there over many messages, each one reasonable on its own. A filter that checks one message at a time sees nothing. We corrected an open model against this in its weights: harmful help fell from about 7 conversations in 10 to about 1 in 8, at a cost in caution that we let a deployment choose.