Stuart Shieber (@pmphlt@mas.to) (@pmphlt) profile picture

Harvard computer science prof interested in scholarly communication.

Joined February 2010
Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)Photo by Stuart Shieber (@pmphlt@mas.to) (@pmphlt)
All records pre-2023 increase in size of bases.
1
3
Which patents get accepted? How do the standards for innovation evolve over time? What kinds of technologies turn over more quickly? In joint work with Mirac Suzgun @lukemelas @skominers and @pmphlt, we introduce a dataset that may help address questions like these [1/n]
6
33
6
135
I do not think it is possible to say very much with confidence about the sentience of LaMDA — or of any other computer system — on the basis of transcripts. @pmphlt’s “The Turing Test as Interactive Proof” convincingly explains why not. dash.harvard.edu/handle/1/20… 1/
4
6
3
20
If the last two years were a movie, in which scientists develop a near-perfect vaccine for a deadly plague, but half the country won't take it, you'd be like: "This is too dumb to watch."
191
1,593
117
9,725
The results are in this new #ACL2021NLP paper: arxiv.org/abs/2106.06087 Hoping this encourages more work using mediation analysis to reveal internal mechanisms in language models. 4/4
1
7
Sometime in the last month, the guide to good practices for university #openaccess policies that I maintain with @pmphlt passed the milestone of 300,000 page views. bit.ly/goodoa
1
2
8
Replying to @CarlosODonell
That’s the most important thing I learned in college. (Unless you count meeting my wife. But we’re still married because I try to make it easy for her to give me an “A”.) Giving credit where it’s due, I learned it from @pmphlt.
1
3
I've never asked for retweets before, but please retweet this in an effort to put an end to this madness: tinyurl.com/x3ywt3ca @CNN et. al. Please. It's "MLB," not "the MLB." It stands for "Major League Baseball." No one says "The Major League Baseball is working with. . . ."
2
19
7
39
Every time someone says we are close to solving NLG they should be forced to read 5 of these summaries from Shashi Narayan's paper. huggingface.co/datasets/view…
3
14
1
82
New @NeurIPSConf paper: "Investigating Gender Bias in Language Models Using Causal Mediation Analysis" Link: proceedings.neurips.cc/paper… With @jesse_vig @sebgehr Sharon Qian @DanielNevo @yaronsinger @pmphlt
1
12
5
92
"The recent decision of many of these publishing houses to NOT put coronavirus articles behind a paywall as their contribution to saw lives exposed their duplicity. Are the lives of people with diabetes or heart disease or cancer not worth saving?" Ali S Khan p938 #OAintheUSA 2/2
12
21
Trump's hideous brag "So I said to my people, slow the testing down, please" is even more disgusting given that everyone who enters the White House is *tested daily* to keep him safe.
1
1
Chatbots often say pretty weird things😅 Ever wondered if there was a way to probe them for specific conversational skills? Check out our new paper! Joint work with @boknilev and @pmphlt! Paper: arxiv.org/abs/2006.08331 Code: github.com/AbdulSaleh/dialog…
1
3
10
Morning routine: My wife watches political news on her laptop, with earphones, and I read. Every now and then she blurts out, "Because you're a fucking asshole!" #PandemicLife
3
1
33
Dear Reviewers: Don't reject because we made it look easy. Making it look easy is hard work. Don't reject because our solution is simple. Simple solutions often have the most impact. Don't reject because you can imagine additional experiments. There's a page limit.
29
729
53
4,132
Food for thought for #acl2020nlp reviewers: if the work seems "trivial", "expected", or "straightforward", this isn't necessarily a bad thing. In fact, it may mean that the authors did a good and convincing job. @pmphlt has a nice take on this: eecs.harvard.edu/~shieber/Bl…
3
14
2
90
This is a great work. Those graphs are amazing, and even more so when you understand what they mean
1
3
Don’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference Yonatan Belinkov (@boknilev) Adam Poliak (@azpoliak) Stuart M. Shieber (@pmphlt) Benjamin Van Durme (@ben_vandurme) Alexander Rush (@harvardnlp) #ACL2019
1
1
1
Over 50 years ago, a student borrowed Alice in Wonderland from our library and never returned it—until today.
10
122
29
629
I am excited to start new position at Harvard @hseas as Gordon McKay Professor of Computer Science & Director Center for Research on Computation & Society @HCRCS start Aug'19. Enjoyed years at USC; onto exciting #AIforGood work at Harvard @harvard_data @pmphlt @harvardchanIRC
34
11
7
201