
Runner, CS PhD candidate @UCSC, and baseball fan - but not necessarily in that order
Joined January 2022
- Tweets61
- Following172
- Followers29
- Likes1.4K
Oliver Chang retweeted
My acceptance speech at the Turing award ceremony:
Good evening ladies and gentlemen.
The main idea of reinforcement learning is that a machine might discover what to do on its own, without being told, from its own experience, by trial and error. As far as I know, the first person to propose this was Alan Turing in 1947, which makes it particularly gratifying and humbling to receive this award in his name for reviving this essential but still nascent idea.
I have three people that I would like to particularly thank.
First, Andy Barto. As my PhD supervisor he taught me my whole approach to science, and in particular instilled in me an appreciation of scholarship and craft, and of the great breath of prior work.
Second, I would like to thank Oliver Selfridge, my other main mentor; sadly, now deceased. Oliver taught me how keeping ideas simple can be the boldest of all ambitions.
Third, I want to thank Martha Steenstrup, my life partner and intellectual sparring partner. She keeps me honest and grounded.
Finally, I also want to thank the University of Alberta, which has been an ideal environment for me and for reinforcement learning research these past 22 years.
These three people and my university have reinforced in me the ambition to have ideas that matter, without getting too full of myself about it. They taught me that the quest for better ideas is serious, but is best approached playfully, with humility, kindness, and optimism. For this I am eternally grateful.
I would also like to thank all of you for being here and for celebrating the pursuit of intellectual excellence.
Thank you very much.
Heart rate is the pulse of progress. Here is my average heart rate for every run leading up to the Monterey Bay Half Marathon
Happy Opening Day! Some takes:
- I have the Dodgers v Orioles in the WS. Dodgers take it in 5
- NL west will finish in 1. Dodgers, 2. Dbacks, 3. Giants, 4. Padres, 5. Rockies
- Tyler Glasnow wins the Cy Young Award
#LetsGoDodgers
Oliver Chang retweeted
Heading to #AAAI2024 today with @runnerdude97 to meet up with @larosabiagio and others for the XAI for DRL workshop: xai4drl.github.io/. Let me know if you're around!
⚾️ Immaculate Grid 209 9/9:
Rarity: 68
IMMACULATE!
🟩🟩🟩
🟩🟩🟩
🟩🟩🟩
Play at:
immaculategrid.com
@immaculategrid x @baseball_ref
Channeling energy from 1950: the biggest comeback win for the #Dodgers with an 8 run deficit
A Markov chain of pitch count sequences. Each Cell represents the probability of going from a particular pitch count (state) to the next outcome. Below I compare 2017 Clayton Kershaw and rookie Jordan Montgomery.
#MLB
#baseballstats
#Dodgers
Markov chains are a crucial component to Markov Decision Processes, which serve as the underlying mathematics for Reinforcement Learning. I hope to use drl to develop AI driven baseball analytics soon!

















