pierre (@pidueck) header
pierre (@pidueck) profile picture

things, stuff

Joined September 2017
Photo by pierre (@pidueck)
Still Red. Still Read. Proud to show off the new third edition of "The Algorithm Design Manual"! algorist.com/
6
21
4
192
This is a very compelling demo! SQLite in WASM as the state engine for a reactive JavaScript application, such that if you modify rows in the database the UI automatically updates to match
Replying to @geoffreylitt
One fun preview: here I'm using a general-purpose SQL editor to *live edit* the UI state of a GUI app 🤯 In some sense, it's "Wildcard done right": imagining a future where apps openly expose data as a means of interop...
2
14
1
92
I had fun giving this talk in @chipro 's ML Systems Class @Stanford about a subject we don't talk about enough: 1. How to evaluate ML Tooling 2. How to spot & deal with 🔥Tool Zealots 🔥 We have recorded the full talk 👇 youtu.be/GHk5HMW4XMA Also a 🧵👇
5
68
16
414
In Q1 2019, 39% of Stripe's hiring was outside Bay Area and Seattle. Last quarter, it was 74%. I think the rate at which tech industry is going global is still under-appreciated, and that this will be a big tailwind for the world over the next decade.
223
1,266
329
10,819
Inspired me to look up the same numbers. For Coinbase, Q1 2019 was 30% outside the Bay Area, and last quarter (Q4 2021) was 89% outside the Bay Area. Tech is definitely decentralizing. Silicon Valley is now in the cloud.
In Q1 2019, 39% of Stripe's hiring was outside Bay Area and Seattle. Last quarter, it was 74%. I think the rate at which tech industry is going global is still under-appreciated, and that this will be a big tailwind for the world over the next decade.
266
466
118
3,982
Replying to @patrickc
Same thing: In 2019, 48% of @Cloudflare’s hiring was outside the Bay Area. Today it’s 78%. Our San Francisco office is our only office globally that shrank in 2021.
4
15
3
230
2021 was an exciting year for web3. 🚀 👀Thought it'd be fun to kick off 2022 with... 130+ interesting web3 startups/tools.👇
20
83
30
314
Here's our most epic video of 2020. Turn the sound up!
466
3,716
1,357
19,849
Hello! A lot of you have started following me in the last couple of months, so let me introduce you to some people I respect, who've created some of the pandemic writing that's really stuck with me.
149
1,741
592
6,526
In our preprint “The large learning rate phase of deep learning: the catapult mechanism" arxiv.org/abs/2003.02218, we show that the choice of learning rate (LR) in (S)GD separates deep neural net dynamics into two sharply distinct types (or "phases", in the physics sense). (1/n)
1
51
5
294
Predicting + demonstrating counterintuitive neural network training behavior: - training at learning rates which diverge under NTK theory - exponential *increase* in loss over first ~20 training *steps* (not epochs) - drastic reduction in Hessian eigenvalues over first ~20 steps
In our preprint “The large learning rate phase of deep learning: the catapult mechanism" arxiv.org/abs/2003.02218, we show that the choice of learning rate (LR) in (S)GD separates deep neural net dynamics into two sharply distinct types (or "phases", in the physics sense). (1/n)
1
10
34
Appreciate the interest in #Georgia & the many Georgians who explained to me how hard we're all struggling to do the right thing, among them @JasmineForHD108, @RepMParis, @TrammellBob, @Seth_C_Clark, @JennJonesATL, @joshuasweitz. Grateful for you all. nytimes.com/2020/04/30/opini…
6
17
This is very cool work. Read this if you want to really, really understand how a neural network solves a specific problem -- like actual scientific understanding.
#tweeprint time for our new work out on arXiv!📖We've been trying to understand how recurrent neural networks (RNNs) work, by reverse engineering them using tools from dynamical systems analysis—with @SussilloDavid. arxiv.org/abs/2004.08013
1
15
95
I have some exciting news to share. After spending some wonderful years at Northeastern, I will be joining @ucsd_cse at @UCSanDiego as an Assistant Professor in July 2020. I want to thank all my mentors for their support, and for folks at UCSD for making this happen.
46
8
3
399
A Survey of Deep Learning for Scientific Discovery To help facilitate using DL in science, we survey a broad range of deep learning methods, new research results, implementation tips & many links to code/tutorials Paper arxiv.org/abs/2003.11755 Work with @ericschmidt Thread⬇️
15
402
39
1,255
Where there is a will there is a way
TFW you start reading a tweet and half way through start to realize it's about you. 🧐
I'm delighted to be joining the faculty at Stanford to lead a new Center on Advanced Studies of the Digital Economy. Very much looking forward to working with the amazing folks @StanfordHAI, @SIEPR, @StanfordGSB and @Stanford Dept of Economics. siepr.stanford.edu/news/erik…
105
92
54
1,161
Wow, thanks a lot for your kind words, Tim! 😊 It's been a wild and exciting ride, and I feel incredibly grateful to everyone who helped me along the way. The field is moving so fast, I'm curious to see what this new decade will bring! 🦎
7
30
2
184
pierre retweeted
Frustrated with the complexity and challenge of working with extra-wide datasets? Check out how the Sisu #ML team uses graph coloring to perform efficient column reduction in wide datasets without sacrificing data quality. sisu.ai/blog/graph-coloring-…
2
2