Ryan Lin retweeted
A very interesting area of research!
The future of voice interfaces requires a large amount of visual understanding as well
Both will come hand in hand
Introducing Orion, a foundation model that predicts where you look. Orion finds twice as many UX bugs as frontier models, cuts computer-use latency by 31%, and even won a drone race.
Orion resembles human behaviour and can spot the odd one out.
Predicted gaze concentrates on a misplaced shoe, female duck, pink blossom tree, and red leaf.
1
19
1,266
We are releasing an open-source pipeline to predict your user sentiment from computer actions
Connect to your existing session replay tool
Prevent loss of signal with high-fidelity mouse capture
Pick refined recipes to train sentiment models on your user data
Check it out: paradigmmachines.ai/orion
6
8
556
Synthetic sentiment labelling with VLMs allows us to push past previous data walls
VLMs can label based off semantic (prompt) and visual (UX) context
22
The issue with sentiment classification is there hasn't been enough labelled data to do it at scale
Sentiment classification demonstrates log linear scaling
156
claude was probably trained in 'cruel' environments that would violate their own terms of service
159








