Scott Gray (@scottgray76) profile picture

Currently independent. Exploring some neuro-inspired AI approaches. Former GPU geek at @OpenAI. He/Him.

San Francisco, CA
Joined April 2009
Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)Photo by Scott Gray (@scottgray76)
Scott Gray retweeted
The case for 4-bit precision: k-bit Inference Scaling Laws abs: arxiv.org/abs/2212.09720
2
12
1
88
32,071
One of the many lessons we should be learning from COVID: the importance of statistics education. Understanding causality and probability is critical to being informed and making wise choices. How much better off would we be if schools replaced trig or calculus with stats?
210
857
254
4,407
How do we beat COVID-19, *while protecting our mental & financial health?* Epidemiologist @MarcelSalathe & I explain Epidemiology 101, #TestTraceIsolate, #MasksForAll, worst-case scenarios... all with playable simulations! 🕹 Check it out! 😷ncase.me/covid-19/😷 (30 min)
19
391
82
797
New video: Simulating an epidemic. What happens when people avoid each other for the most part but still go to a common central location like a store? What if you can track and isolate cases, but 20% slip through the cracks? 50%? And much more. youtu.be/gxAaO2rsdIs
106
2,069
474
5,045
Scott Gray retweeted
The fact that primaries are not done via ranked-choice voting is absurd
46
406
39
2,848
Scott Gray retweeted
We've trained an unsupervised language model that can generate coherent paragraphs and perform rudimentary reading comprehension, machine translation, question answering, and summarization — all without task-specific training: blog.openai.com/better-langu…
420
2,742
1,246
12,109
Scott Gray retweeted
Random Network Distillation: A prediction-based method that achieves state-of-the-art performance on Montezuma’s Revenge -blog.openai.com/reinforcemen…
8
151
22
492
Scott Gray retweeted
A real robot hand, trained with same learning algorithm and code as OpenAI Five, has learned human-like motions to rotate objects: blog.openai.com/learning-dex…
33
514
81
1,268
Scott Gray retweeted
Our team of five neural networks, OpenAI Five, has started to defeat amateur human teams (including a semi-pro team) at Dota 2: blog.openai.com/openai-five/
53
761
193
2,085
Scott Gray retweeted
How big is the sudden explosion of startups building AI chips? There are 45 of them, and at least five have raised $100 million: nyti.ms/2EEpICX
7
162
22
328
Scott Gray retweeted
In a few minutes, watch our Dota 2 AI play live on main stage at The International: openai.com/the-international…
46
685
76
2,207
Scott Gray retweeted
We proudly gave @OpenAI our NVIDIA DGX-1 supercomputer to work on #AI's toughest problems. nvda.ws/2aRtOhE
216
1,276
399
11,567
Scott Gray retweeted
Paper on Nyami synthesizable GPU architectural model and potential open source GPU #Verilog ieeexplore.ieee.org.sci-hub.…
1
59
107
Scott Gray retweeted
Today we’re proud to announce the open source release of TensorFlow, our second-generation machine learning system - goo.gl/uX0dV5
14
721
717
Neural Networks with Few Multiplications arxiv.org/abs/1510.03009
1
26
53
Kernels from @nervanasys have made a huge difference in our RNN training. See details in this post by @erich_elsen: svail.github.io
10
20