Turning sand into intelligence. One bitter lesson at a time.
Joined June 2024
- Tweets74
- Following2
- Followers474
- Likes21
Pinned Tweet
If you want models to work on tasks for months, you have to train on months-long trajectories.
Today we release an inverse dynamics model for screencasts.
It watches a screencast and recovers the actions behind the pixels: keys, clicks, cursor movement and scrolls. 🧵(1/5)
p(doom) retweeted
Grifter SF startup openly published 11h of screencasts and calls our dataset 'less open-ended'
We have 15,000 hours of screencasts of top-tier PhD students working over 3-12 months.
Their longest trajectory is 12h. Ours is 12 months.
🤖 Made with AI
We're releasing RealCUA, the first computer-use dataset of open-ended work in evolving environments.
600+ hours (and growing!) of real multi-objective work with interleaved tasks across thousands of steps in realistic desktops.
11-hour sample & access: data.fig.inc/realcua
p(doom) retweeted
Your claim is not true.
7 months ago, we openly released 600+ hours of the 15,000 hours we have internally (of top-tier PhD students working over 3-12 months).
Also, our cross-platform capture tooling is open source.
teapawt.net/prob_doom/status/20372…
p(doom) retweeted
We're spending $250,000 to record cracked people working.
The problem: finding them.
So we printed 10,000 flyers and started hitting Europe’s AI hubs.
The model was trained only on macOS data, but transfers to Windows and Linux without adaptation.
Mouse movement and clicks generalize best. The remaining cross-platform errors are mostly hotkey confusion. (4/5)
We release code, IDM and 600h of annotated long-horizon screencasts.
We pay $300/mo to record your screen while working. Now on every OS.
Blog: pdoom.org/crowd_cast_idm.htm…
Apply ($300/mo): forms.gle/YKJn7m4X7WhtVfRm7
Model: huggingface.co/p-doom/idm
Data: huggingface.co/datasets/p-do… (5/5)
TRY US
200k nukes, these traces are never going to be on-policy, my policy cant be imitated teapawt.net/ComplexMusic/status/98…
We’re p(doom), an AGI research lab. We’ll pay you $300/month to record your screen while working.
If your work is open-source and involves research, engineering, design, editing, or similar long-horizon digital work, fill out the form: forms.gle/Um8pzes644tL661F8
p(doom) retweeted
Since @_rockt's banger position paper is going viral, here is a a set of notes we (@maharajamihir) made in 2024 while brainstorming paths towards AGI in front of an empty whiteboard: docs.google.com/document/d/1…
As with crowd-code and AGI-CAST, we will publish the cleaned dataset under the most permissive Creative Commons license (CC0). (8/n)
If you openly publish your work, consider participating in crowd-sourcing by installing crowd-cast. (n/n)
🖥️ crowd-cast: github.com/p-doom/crowd-cast…
🌐 Blog: pdoom.org/crowd_cast.html
📈 Dashboard: pdoom.org/crowd_cast_dashboa…
🤗 Dataset: huggingface.co/datasets/p-do…
