Father of nine. Professor of computer science at BYU; working on big language models. Mormon and lovin' it!
- Tweets26
- Following35
- Followers138
- Likes23
ALT GPT-3 can simulate people very, very well – social science might change: …Turns out a synthesis engine trained on the exhaust of human culture can be pretty good at simulating people… Researchers with Brigham Young University have written a paper which I think is among the most significant things I’ve ever covered in this newsletter. Specifically, they do three social science experiments on GPT-3 and discover that GPT-3 has biases that are “fine-grained and demographically correlated, meaning that proper conditioning will cause it to accurately emulate response distributions from a wide variety of human subgroups.” Put another way: You can simulate people in GPT-3 and they might respond with uncanny similarity to real people in real life. Sit with that for a minute and spool out the implications, while mentally turning the crank on model size advancements.
ALT GPT-3 can simulate people very, very well – social science might change: …Turns out a synthesis engine trained on the exhaust of human culture can be pretty good at simulating people… Researchers with Brigham Young University have written a paper which I think is among the most significant things I’ve ever covered in this newsletter. Specifically, they do three social science experiments on GPT-3 and discover that GPT-3 has biases that are “fine-grained and demographically correlated, meaning that proper conditioning will cause it to accurately emulate response distributions from a wide variety of human subgroups.” Put another way: You can simulate people in GPT-3 and they might respond with uncanny similarity to real people in real life. Sit with that for a minute and spool out the implications, while mentally turning the crank on model size advancements.
