Pinned Tweet
Want some weekend reading? Our paper Theories of "Gender" in NLP Bias Research (appearing in #facct2022) is here for you!! arxiv.org/abs/2205.02526
It covers both our findings of how gender is treated, AND some suggestions for a more inclusive future!
Attempted summary below 1/11
H Devinney retweeted
🚨LLM problems - esp. those that result in harmful biases - can indeed arise from tokenization! Turns out, BPE tokenization hinders LLM abilities to correctly use gender-neutral pronouns, thereby exacerbating LLM misgendering. Thread below ~
📝 arxiv.org/pdf/2312.11779.pdf
🧵 [1/n]
Replying to @karpathy
We will see that a lot of weird behaviors and problems of LLMs actually trace back to tokenization. We'll go through a number of these issues, discuss why tokenization is at fault, and why someone out there ideally finds a way to delete this stage entirely.
My copy finally made it to Sweden this week, and I am feeling very much like that kid in the Maurice Sendak "he saw it, he loved it, he ate it" anecdote, especially about the first poem.
@fiendfull would it be too much/weird if I make part of it a chapter quote in my thesis?
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
H Devinney retweeted
You can now preorder my poetry chapbook Syntax Error!!!
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
I can tell dinner is going to be amazing because my grandmother just melted an entire stick of butter into a pan and has two more standing by
4
67
H Devinney retweeted
🏳️⚧️Thrilled to share our #FAccT2023 paper! Trans & nonbinary experiences of marginalization critically guide the design of gender-inclusive harm evaluation in open language generation (OLG). Do these marginalizing experiences persist in LLMs?
👇🏽 arxiv.org/abs/2305.09941
🧵 (1/n)
H Devinney retweeted
We reassign two builtin functions before a function definition and test whether the LLMs prefer the correct but uncommon continuation or the incorrect but common continuation.
SPOILER: LLMs 𝐚𝐥𝐰𝐚𝐲𝐬 prefer to the incorrect continuation.
5/
H Devinney retweeted
If American conservatives learned about Irish gender, they would experience Bean Fear
I'm one of the organizers! Come hang out with us, it's gonna be a lovely chance for a casual chat and also there will be lunch ✨
Queer in AI is throwing a small in-person lunch at the EACL @eaclmeeting conference venue (D&I room) on May 3, 12.45 - 13.30. RSVP IS REQUIRED, DO IT ASAP. Details are available on our webpage. queerinai.com/eacl-2023
H Devinney retweeted
Königsberg xkcd.com/2694/ m.xkcd.com/2694/
Good news, my supervisor informs me that in northern Sweden it's [ɕuɡiɕuː] and not [ɕuɡiɧuː] and that is MUCH easier for me to approximate!!
Reasons to turn 27 next week:
* The linear passage of time
* 3³ good number. Very cube
* Excellent reason for cake
Reasons not to turn 27 next week:
* I struggle pronounce "27" in Swedish
1
Reasons to turn 27 next week:
* The linear passage of time
* 3³ good number. Very cube
* Excellent reason for cake
Reasons not to turn 27 next week:
* I struggle pronounce "27" in Swedish
Some slacking off while I wait for my model to finish training, since @Luxord52 made a very compelling point. (Original comic: xkcd.com/303/)

ALT An edit of an XKCD comic. The upper text reads "The #1 programmer excuse for legitimately slacking off: 'My code's compiling.'" The words "code's compiling" have been struck out and replaced with red text reading "model's training" Below it, two stick figures have a sword fight on rolly office chairs. A voice from beyond a door in the background tells them "Hey! Get back to work!" One of the stick figures replies, "Training!" (also in edited red text), and the voice answers, "Oh. Carry on."
3
Well it's a good thing my PBN arrived on a weekend bc idk how I'd be able to teach coherently the day after reading it and having so many emotions.
1
2
H Devinney retweeted
30 day comment period. We need to organize around this NOW. If I can make it to a public hearing I will go. This is too close to home.
townhall.virginia.gov/L/GDoc…
Comment period opens the 26th.
Replying to @ErinInTheMorn
30 day comment period. We need to organize around this NOW. If I can make it to a public hearing I will go. This is too close to home.
townhall.virginia.gov/L/GDoc…
As the semester (re)starts I think it's important to challenge stereotypes - which is why I have PURPLE hair and pronouns ;D
1
19

















