Workshop on Large Language Model Memorization (@l2m2_workshop) header
Workshop on Large Language Model Memorization (@l2m2_workshop) profile picture

The First Workshop on Large Language Model Memorization.

World
Joined September 2024
📢 @aclmeeting notifications have been sent out, making this the perfect time to finalize your commitment. Don't miss the opportunity to be part of the workshop! 🔗 Commit here: openreview.net/group?id=aclw… 🗓️ Deadline: May 20, 2025 (AoE) #ACL2025 #NLProc
1
8
12
1,547
L2M2 will be tomorrow at VIC, room 1.31-32! We hope you will join us for a day of invited talks, orals, and posters on LLM memorization. The full schedule and accepted papers are now on our website: sites.google.com/view/memori…
5
1
12
7,771
Workshop on Large Language Model Memorization retweeted
I'm psyched for my 2 *different* talks on Friday @aclmeeting: 1.@llm_sec (11:00): What does it mean for an AI agent to preserve privacy? 2.@l2m2_workshop (16:00): Emergent Misalignment thru the Lens of Non-verbatim Memorization (& phonetic to visual attacks!) Join us!
1
12
1
86
5,769
Workshop on Large Language Model Memorization retweeted
I'll be at #ACL2025 next week! Catch me at the poster sessions, eating sachertorte, schnitzel and speaking about distributional memorization at the @l2m2_workshop
1
11
1
89
5,030
L2M2 is happening this Friday in Vienna at @aclmeeting #ACL2025NLP! We look forward to the gathering of memorization researchers in the NLP community. Invited talks include: @yanaiela @niloofar_mire @rzshokri and see our website for the full program. sites.google.com/view/memori…
13
27
2,026
Workshop on Large Language Model Memorization retweeted
For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦
17
133
46
613
178,892
Workshop on Large Language Model Memorization retweeted
Do language models just copy text they've seen before, or do they have generalizable abilities? ⬇️This new tool from Ai2 will be very useful for such questions! And allow me to plug our paper on this topic: We find that LLMs are mostly not copying! direct.mit.edu/tacl/article/… 1/2
For years it’s been an open question — how much is a language model learning and synthesizing information, and how much is it just memorizing and reciting? Introducing OLMoTrace, a new feature in the Ai2 Playground that begins to shed some light. 🔦
1
6
74
7,878
Workshop on Large Language Model Memorization retweeted
As infini-gram surpasses 500 million API calls, today we're announcing two exciting updates: 1. Infini-gram is now open-source under Apache 2.0! 2. We indexed the training data of OLMo 2 models. Now you can search in the training data of these strong, fully-open LLMs. 🧵 (1/4)
2
15
65
6,563
Hi all, reminder that our direct submission deadline is April 15th! We are co-located at ACL'25 and you can submit archival or non-archival. You can also submit work published elsewhere (non-archival) Hope to see your submission! sites.google.com/view/memori…
7
1
11
1,749
Workshop on Large Language Model Memorization retweeted
Want to know what training data has been memorized by models like GPT-4? We propose information-guided probes, a method to uncover memorization evidence in *completely black-box* models, without requiring access to 🙅‍♀️ Model weights 🙅‍♀️ Training data 🙅‍♀️ Token probabilities 🧵1/5
4
46
3
204
28,189
Hey all, we will be retweeting works on memorization. Please DM us if you want us to retweet your work. Our submission deadline is 4/15, consider submitting to one of our archival or non-archival tracks!
1
94
Workshop on Large Language Model Memorization retweeted
Adding or removing PII in LLM training can *unlock previously unextractable* info. Even if “John.Mccarthy” never reappears, enough Johns & Mccarthys during post-training can make it extractable later! New paper on PII memorization & n-gram overlaps: arxiv.org/abs/2502.15680
4
13
2
83
5,866
Workshop on Large Language Model Memorization retweeted
we show for the first time ever how to privacy audit LLM training. we give new SOTA methods that show how much models can memorize. by using our methods, you can know beforehand whether your model is going to memorize its training data, and how much, and when, and why! (1/n 🧵)
1
22
2
126
14,289
📢The First Workshop on Large Language Model Memorization (L2M2) will be co-located with @aclmeeting in Vienna🎉 💡L2M2 brings together researchers to explore memorization from multiple angles. Whether it's text-only LLMs or Vision-language models, we want to hear from you!🌍
1
4
3
13
4,592
📝 Key Deadlines: - ARR submission: Feb 15, 2025 - Direct submission: Mar 25, 2025 - ARR commitment: Apr 17, 2025 - Notification: Apr 27, 2025 - Camera-ready: May 16, 2025
1
4
159
🎉 Happy to announce that the L2M2 workshop has been accepted at @aclmeeting! #NLProc #ACL2025 More details will follow soon. Stay tuned and spread the word! 📣
5
2
35
14,475