SITUATION EXPLAINED: Can you generate a deepfake of someone without ever typing their name? We asked @LukeArrigoni, founder and CEO of @lotiapp "If you watermark a deepfake, that's great, but it doesn't stop the fact that the deepfake is there. The watermarks are also invisible, so the damage could still be done." "There's a mechanism before it gets watermarked where there's an allowance that says: should it be made at all?" "What if someone says something tricky, someone that's really famous with a makeup brand that comes from a famous family that did a reality TV show. You could describe it and not use her name, and you can nudge the model to literally recreate her perfectly. You could even say the birth order and stuff like that." "We call that the latent space attack. Latent space in a model is essentially where you surround the area of a person and describe everything around it... the inside part is the latent space." "If I told you a man that's stranded on an island with a volleyball that turns into his best friend, you would probably immediately know who I'm talking about. And so would most models. But our system can detect that as well and then stop it."