Researcher @AlibabaGroup; Phd @ZJU_China; Before: Visiting Phd @UCLA; Intern @MSFTResearch; @AntGroup
Joined April 2022
- Tweets106
- Following202
- Followers128
- Likes441
Pinned Tweet
🚨 New Blog Drop!
🚀 "Reflection on Knowledge Editing: Charting the Next Steps" is live!
💡 Ever wondered why knowledge editing in LLMs still feels more like a lab experiment than a real-world solution? In this post, we dive deep into where the research is thriving — and where it's falling short. From foundational breakthroughs to the practical roadblocks no one’s talking about, we connect the dots and propose what’s needed to move forward. Join the conversation! #KnowledgeEditing #LLMs #AI #ModelEditing
📌 If you're working on LLMs, model updates, or mechanism interpretability, you don’t want to miss this.
👉 Read the full post: yyzcowtodd.cn/rethinkedit
Key insights from our analysis:
0⃣ Current evaluation metrics and benchmarks inadequately assess knowledge updates in LRMs, highlighting the need for more comprehensive evaluation frameworks.
1⃣ Scaling challenges persist, with significant memory and computational constraints limiting the practical application of editing methods for larger or quantized local models.
🎁 Resource Release: To support the research community, we release covariance matrices for Qwen2.5-32B & QwQ-32B models for the current locate-and-edit methods.
2⃣ We outline promising research directions for developing language models that can effectively learn, adapt, and evolve their knowledge base.
Huge thanks to the brilliant collaborators who made this deep dive into #ModelEditing possible! @uclanlp @CanyuChen3 @Jiachen_Gu @dsmall2apple1 @ManlingLi_ @VioletNPeng
🧠 Unlock the black box of LLMs at #KDD2026!
Join our Tutorial on Interpretability in the Era of Large Language Models.
📅 Aug 9 | 1:00–5:00 PM KST
📍 Room 401B, ICC Jeju, Korea
Come and chat with us! 🔍✨
#LLM #Interpretability #MachineLearning #AI #KDD2026
Just landed in Seoul for #ICML2026! 🛬🇰🇷
If you're into interpretability / explainable AI, I'd love to chat！Feel free to DM me or grab me at the venue!
1
100
I've just arrived in Suzhou 🇨🇳 and will be here until Nov 9! #EMNLP #LLMs
Third EMNLP for me and Excited to chat about LLMs, interpretability, and agents 🤖
I'll be presenting:
🧩 CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
🕑 Fri 2 PM | Hall C | Session 15
🔗 arxiv.org/abs/2503.16356
🤝 Exploring Model Kinship for Merging Large Language Models
🕧 Fri 12:30 PM | Hall C | Session 8
🔗 arxiv.org/abs/2410.12613
Let's connect!
🍰Check out our latest work, CaKE on Knowledge Editing!
🍰 Introducing CaKE: Circuit-aware Knowledge Editing for LLMs! 🚀
Current knowledge editing methods update single facts but struggle with multi-hop reasoning. We propose CaKE to solve this by aligning edits with the model's reasoning pathways, enabling accurate and consistent use of updated knowledge!
📄 Paper: arxiv.org/abs/2503.16356
⌨️ Code: github.com/zjunlp/CaKE
Why CaKE?
LLMs sometimes give us correct answers for single-hop questions but fail on their combined multi-hop questions, especially after edits.
We find two main issues through the reasoning circuit: weak signal and propagation failure. Additionally, current layer-specific knowledge editing methods also struggle to incorporate the edited knowledge into the reasoning pathways.
CaKE tackles these challenges by creating specialized tasks that force the model to use updated knowledge during reasoning, building robust circuits for new information.
Results: CaKE outperforms early-layer editing methods like MEMIT and ROME, as well as later-layer editing methods like WISE, on the MQuAKE benchmark. This breakthrough paves the way for more reliable and updatable LLMs! 💬
We're excited to hear your thoughts and feedback!
#AI #LLMs #KnowledgeEditing #NLP #ModelEditing
4
137
I'll be at #NeurIPS Vancouver between 12/9 and 12/15.
If you're around, let's connect and share ideas!
Happy to chat about anything related to knowledge and reasoning.
We are going to present the following works at #NeurIPS2024 covering knowledge editing, mechanism and agents. Welcome to discuss with the presenters @dsmall2apple1 @yyzTodd ! (ps: I'm not attending)
[Knowledge Editing] WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models
Location: East Exhibit Hall A-C #3403
Time: Wed 11 Dec 4:30 p.m. PST — 7:30 p.m. PST
Also at Foundation Model Interventions Workshop
Location: West Meeting Room 121, 122
Time: Sun 15 Dec, 8:15 a.m. PST
[Knowledge Mechanism] Knowledge Circuits in Pretrained Transformers
Location: East Exhibit Hall A-C #3211
Time: Thu 12 Dec 4:30 p.m. PST — 7:30 p.m. PST
[Knowledgeable Agents] Agent Planning with World Knowledge Model
Location: East Exhibit Hall A-C #3311
Time: Thu 12 Dec 11 a.m. PST — 2 p.m. PST
4
348
Cool!
🚀Delighted to explore "Knowledge Editing for Large Language Models" at #AAAI24 alongside @zxlzr, @JasonForJoy, @yao_yunzhi, and @Bizhen_Ray. Immense gratitude to the organizers.
@RealAAAI
#Tutorial #NLP #LLM #ModelEditing
📚 Paper: arxiv.org/abs/2305.13172
5
189
🤔 Want to keep your AI agent up-to-date and aligned with your ideas? Try cutting-edge model editing methods! 🛠️💉
🧐 Dive into our #EMNLP2023 paper for a comprehensive review of LLMs editing techniques.
📄 Paper: arxiv.org/abs/2305.13172
💻 Code: github.com/zjunlp/EasyEdit
