← All lab updates

We correct the model itself, and the correction carries over

Most defences sit in front of the model and read what goes in. We read how the model behaves, find where it gives in, and fine-tune the weakness out of the model itself. Two results on an open 7B model: a correction against commands hidden in documents also works on kinds of task it was never trained on, and the same approach cuts attacks spread over many messages, at two settings of the same method: stronger protection with more cautious refusals, or near-normal caution with attacks cut by more than half.