H Devinney (@HMDevinney) header
H Devinney (@HMDevinney) profile picture

Your local puffin in a lab coat. they/them

Joined October 2013
Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)Photo by H Devinney (@HMDevinney)
Want some weekend reading? Our paper Theories of "Gender" in NLP Bias Research (appearing in #facct2022) is here for you!! arxiv.org/abs/2205.02526 It covers both our findings of how gender is treated, AND some suggestions for a more inclusive future! Attempted summary below 1/11
2
8
1
29
🚨LLM problems - esp. those that result in harmful biases - can indeed arise from tokenization! Turns out, BPE tokenization hinders LLM abilities to correctly use gender-neutral pronouns, thereby exacerbating LLM misgendering. Thread below ~ 📝 arxiv.org/pdf/2312.11779.pdf 🧵 [1/n]
Replying to @karpathy
We will see that a lot of weird behaviors and problems of LLMs actually trace back to tokenization. We'll go through a number of these issues, discuss why tokenization is at fault, and why someone out there ideally finds a way to delete this stage entirely.
2
24
5
107
26,489
My copy finally made it to Sweden this week, and I am feeling very much like that kid in the Maurice Sendak "he saw it, he loved it, he ate it" anecdote, especially about the first poem. @fiendfull would it be too much/weird if I make part of it a chapter quote in my thesis?
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
2
1
5
404
You can now preorder my poetry chapbook Syntax Error!!!
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
2
3
4
562
I can tell dinner is going to be amazing because my grandmother just melted an entire stick of butter into a pan and has two more standing by
4
67
🏳️‍⚧️Thrilled to share our #FAccT2023 paper! Trans & nonbinary experiences of marginalization critically guide the design of gender-inclusive harm evaluation in open language generation (OLG). Do these marginalizing experiences persist in LLMs? 👇🏽 arxiv.org/abs/2305.09941 🧵 (1/n)
1
26
3
107
24,473
We reassign two builtin functions before a function definition and test whether the LLMs prefer the correct but uncommon continuation or the incorrect but common continuation. SPOILER: LLMs 𝐚𝐥𝐰𝐚𝐲𝐬 prefer to the incorrect continuation. 5/
6
32
5
187
30,558
If American conservatives learned about Irish gender, they would experience Bean Fear
3
6
59
2,144
I'm one of the organizers! Come hang out with us, it's gonna be a lovely chance for a casual chat and also there will be lunch ✨
Queer in AI is throwing a small in-person lunch at the EACL @eaclmeeting conference venue (D&I room) on May 3, 12.45 - 13.30. RSVP IS REQUIRED, DO IT ASAP. Details are available on our webpage. queerinai.com/eacl-2023
1
1
5
697
Good news, my supervisor informs me that in northern Sweden it's [ɕuɡiɕuː] and not [ɕuɡiɧuː] and that is MUCH easier for me to approximate!!
Reasons to turn 27 next week: * The linear passage of time * 3³ good number. Very cube * Excellent reason for cake Reasons not to turn 27 next week: * I struggle pronounce "27" in Swedish
1
Reasons to turn 27 next week: * The linear passage of time * 3³ good number. Very cube * Excellent reason for cake Reasons not to turn 27 next week: * I struggle pronounce "27" in Swedish
1
8
Some slacking off while I wait for my model to finish training, since @Luxord52 made a very compelling point. (Original comic: xkcd.com/303/)
3
Well it's a good thing my PBN arrived on a weekend bc idk how I'd be able to teach coherently the day after reading it and having so many emotions.
1
2
Also so many of you owe me letters but didn't leave me your addresses so I can't send the first one. Pony up.
30 day comment period. We need to organize around this NOW. If I can make it to a public hearing I will go. This is too close to home. townhall.virginia.gov/L/GDoc…
39
599
60
1,816
Comment period opens the 26th.
Replying to @ErinInTheMorn
30 day comment period. We need to organize around this NOW. If I can make it to a public hearing I will go. This is too close to home. townhall.virginia.gov/L/GDoc…
1
1
3
I have an abundance of distressed noises and really no words. I will be setting a calendar reminder to comment. Please do the same. This kind of policy will ruin kids' lives, and probably end them, and we cannot condone it.
1
As the semester (re)starts I think it's important to challenge stereotypes - which is why I have PURPLE hair and pronouns ;D
1
19
It's great that I don't actually teach until tomorrow, because I would be running comically late today for reasons of "my cat was cute and on top of me so I just didn't get out of bed for an hour"
5
the very task of "Correcting to standard grammar" is going to be harm inducing. This is not a "biased AI" problem. The AI didn't create this task.
1
9
1
80