Professor: University of Washington | AI ML | ...

Seattle, WA
Joined December 2008
Replying to @karpathy
The tldr I use: "LLMs always hallucinate. Sometimes their hallicinations align with your reality". Whether or not the prompt makes them hallucinate in a way that aligns with reality depends very much on the prompter's ability to check, and thus.. xitter.cf/rao2z/status/171871473… )
Why we should view LLMs as powerful Cognitive Orthotics rather than alternatives for human intelligence #SundayHarangue LLMs are amazing giant external non-veridical memories that can serve as powerful cognitive orthotics for us, if rightly used (c.f. xitter.cf/rao2z/status/170346612…). The trick, IMHO, is to exploit them without deluding ourselves in the process. The delusion comes chiefly from our incessant need to confuse them for human intelligence, merrily applying anthropomorphic concepts such as thinking , thoughts, reasoning and self-critiquing to LLMs. (c.f. xitter.cf/rao2z/status/170832978…; xitter.cf/rao2z/status/169710160…; xitter.cf/rao2z/status/164890979…) This anthropomorphization is quite futile--and, as shown in the case of some of the current Ersatz Natural Science AI literature--even counterproductive and misleading. Sure we didn't quite foresee how impressive the approximate omniscience of these n-gram models on steroids would be, but that doesn't have to make us assume they do everything humans do. Unless human-level #AI is your singular goal, you don't necessarily need to think auto-regressive LLMs suck (as @ylecun puts it colorfully). LLMs can be very effective complementary cognitive orthotics without subsuming human intelligence. LLMs do some things way way way better than humans do  (the litmus test--from my perspective--being converting anything to iambic pentameter in seconds 😋xitter.cf/rao2z/status/171863933…), and do other things (planning, reasoning, self critiquing, mental modeling) much worse (c.f. ; xitter.cf/rao2z/status/170161286…; xitter.cf/rao2z/status/171580081…; xitter.cf/rao2z/status/164346320…) If we can manage to tone down the "LLMs are Zero-shot <XXX>" studies rife with confirmation biases that conflate approximate retrieval for other capabilities associated with human intelligence (c.f. xitter.cf/rao2z/status/155308270…; xitter.cf/rao2z/status/170785801…), we can: 1. Focus on the right way of leveraging the strengths of LLMs. This can certainly be done in LLM-modulo architectures, with either humans or other specialized sound reasoners in the loop). 2. To the extent human-level intelligence is still your holy grail, keep open research avenues that don't just involve scaling up autoregressive architectures. (It is in this sense that I sympathize with @ylecun's AR-LLMs suck comment--they do, currently, suck the oxygen out of the research room 😅) tldr; you can get much farther with LLMs & #AI if you think of them as cognitive orthotics and can stop anthropomorphizing them.. (c.f. xitter.cf/rao2z/status/167866072…; xitter.cf/deliprao/status/168681…)
21
65
18
464
175,382
Ankur Teredesai retweeted
🎖 This really is such a bookmark-worthy post: 📊 “The Evolution of a ggplot (Ep. 1)” by @CedScherer buff.ly/3hP4A3B #rstats #dataviz [GIF: shows each stage of evolution of the plot]
12
414
40
2,315
Glad to announce that we have 3 papers and 1 tutorial accepted at @2021Ichi Details coming soon. Collaborative work with @ankurt @md_carly @vikasnitr and others #ICHI2021
2
5
Ankur Teredesai retweeted
First time I heard #LinearAlgebra in a movie today: ‘the eigenvalue is all wrong, just program a Fourier transform’ from ‘No way out’ (Kevin Costner et al). Didn’t make much sense of course, but still commendable. Any other such gems I am missing out? #Mathinmovies
5
1
11
Ankur Teredesai retweeted
So proud to see the day that a woman has finally broken through the impenetrable glass ceiling of American high political office @KamalaHarris
48 male US Vice Presidents til now. Today....Vice President Kamala Harris.
3
4
Ankur Teredesai retweeted
Always. Even when it's hard. Even when it's unpopular. Even when it's painful. Just do the right thing. #MLKDay2021
"The time is ALWAYS right to do what is right." Dr #MartinLutherKingJr
3
16
Ankur Teredesai retweeted
tfw the two hardest problems in computer science turn out to be "not building a hostile workplace" and "not actively participating in white supremacy/genocide"
29
1,576
59
9,326
Ankur Teredesai retweeted
Learning one of the most important ML and data science concepts, Bayes Theorem in the context of chilling with your BAE 😀 Probability of chilling given Netflix = (Probability of Netflixing given chilling x Probability of chilling) / Probability of Netflixing
13
214
30
1,201
"The number one skill required for learning any complex system is patience." - Kelsey Hightower
38
1,118
36
5,066
Ankur Teredesai retweeted
“There are decades where nothing happens; and there are weeks where decades happen.” The first three Wednesday’s of 2021: 1/6: insurrection 1/13: impeachment 1/20: inauguration
1
23
1
87
Ankur Teredesai retweeted
15 years! So hard to believe... feels like a lifetime ago!
Happy 15th Birthday jQuery! On January 14, 2006, the software engineer John Resig announced the creation of the jQuery JavaScript library at BarCamp NYC. webdesignmuseum.org/web-desi… #jQuery #InternetHistory
73
207
31
1,605
I am giving a tutorial on Explainable AI "Towards Deep Explanation in Machine Learning Supported by Visual Methods" with Boris Kovalerchuk and @ankurt #IJCAI at today at 4 pm PST Jan 6 (9 am Tokyo Time Jan 7) #IJCAI #XAI
2
7
Ankur Teredesai retweeted
New paper testing whether "natural language understanding" benchmarks actually test language understanding. Answer: No.
Do SotA natural language understanding models care about word order? Nope 🙃, 75% to 90% of the time, for BERT-based models, on many GLUE tasks (where they outperformed humans). "marijuana cause cancer" == "cancer cause marijuana" Ouch... arxiv.org/abs/2012.15180 1/4
13
71
5
291
Ankur Teredesai retweeted
Science often requires having the mental fortitude to persist with a long term research agenda, even when the rest of the field moves on. A fascinating case study, worth the read! wired.co.uk/article/mrna-cor…
2020 was elf-ed up. 🎅 But we still have so much to be grateful for. 🎄🎁 #MerryChristmas #MaskUp #StaySafe – at Charlotte, NC
9
2
36
We did it! Entire captable for $2m round for a B2B deal I led is all women!! Typically, I’m the only woman in the round, more than 1 is a feat so this is a Christmas miracle! 🎄🤗 Appreciate the response! Many women investors here got a look. Deals closed very fast!
I have recently signed 2 term sheets in enterprise companies started by amazing teams. We have some room in the round & founders want to fill the whole round with amazing women investors! If you are an angel investor or women-led fund I would love to share these deals with you!
48
32
8
721
Ankur Teredesai retweeted
Small budget, big results. 📕 Read more: wef.ch/2E2CTPS
16
498
106
1,008
Ankur Teredesai retweeted
Can AI researchers please tweet: I am against racism, sexism, bullying and cancelling, and I believe in improving diversity, equity and inclusion in our AI community. We need to hear your voices! The students and the public need to know what most believe.
85
326
132
1,347
"I felt dad was in the truck with me today." 🤎 Todd Elble, @UPS, delivering the first doses of @moderna_tx #COVID19vaccine. His father, Paul, died of #COVID19 at age 78 in November.  #FrontLineHeroes #MaskUp – at Charlotte, NC
18
204
38
1,545
Ankur Teredesai retweeted
ML community: * create algorithms that optimize for a single objective * Companies: * use ML to optimize for user engagement, which learns to favor extreme content since it gets the most attention * ML community: “Why are people on Twitter getting so extreme?”
15
155
22
1,336