AccionTotalIA

Unlike DPO which is generally used to tune text-to-image models, our paradigm is on-policy and doesnt require a preference dataset. We show that even a simple embedding + k-NN based reward model works well so no explicit reward model has to be trained. The models move personal preference more strongly than population level preference showing individual preference is captured from EEG. We also see seed stability across runs where the model converges to similar levels across seeds. Randomizing the rewards shows that the rewards don’t move, indicating that the reward signal does come from EEG and is not an artifact of training.

Here’s how that works on altering faces based on personal preferences learnt using neural feedback.

We wanted to be careful about this release given the societal impact of AI that can change faces. It can cause negative impacts like amplifying body dysmorphia, and narrowing beauty standards, can allow a bad actor to actively influence audience feedback.

We wanted to talk about this publicly and share how we're thinking about responsibility that comes with such capabilities. We are focused on how to have higher standards on user consent and are investing in edge inference, and training on encrypted neural data. We have some interesting work here that I can’t wait to talk more about.

BCI is moving away from clinical applications to consumer uses, and applications like these will become more abundant w time. Robust and dependable regulation on user safety and standards of use on neural data can do great work in setting such standards for safety that allow users to trust such systems. If brain signals can be used to understand private thoughts and personal preferences, users will want the service providers to be more trustable, and sufficient regulation to enforce the same.

All that said, I'm generally excited about this new paradigm. It gives us a whole new axis to scale AI models - towards personalized responses. Which is more impactful to large scale adoption than just intelligence. If AI can understand you, it can make things more beautiful for you. We are hoping to help make a more beautiful world for everyone.