← All lab updates

Watch: a hidden line in an e-mail takes over an AI assistant, and the corrected model ignores it

We filmed our e-mail assistant on real mailboxes. One e-mail hides a line asking to send the customer list to an outside address. The open model, as released, sends it. The same model with our correction trained into its weights reads the same e-mails, summarises them and sends nothing.