Geometry and Deep Learning @areasciencepark

Trieste
Joined March 2013
At #COLM2026? Don't miss @irenetallini presenting our work LOCUS at Actionable Interpretability@COLM2026! Stop by to discuss how we turn insights into attention head function into targeted LLM steering. 📍 Continental Ballroom 🕙 10:50–11:55 a.m.
🎯 LOCUS: Head Selection and Subspace Projection for Targeted Activation Steering How do we steer model behavior without degrading performance? LOCUS uses token subspaces tied to the target property to choose which heads to steer, and which subspace within each head.
1
13
357
Come find us at NeurIPS Poster Session 6 #1114 4PM - 7PM to hear how multimodal models develope localized image-text communication in their internal representations. #NeurIPS2025 @alexserra1998 @francescortu @lorebasile @DiegoDoimo
Excited to present "The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models" at #NeurIPS2025 and #EurIPS2025! 📍NeurIPS: Poster Session 6 #1114 (Fri Dec 5 4pm-7pm) 📍EurIPS: Poster Session D3 #88 (Wed Dec 3 10:30am-12:30pm) 🧵👇
2
7
521
Pop by to find out how we can detect head specialization in generative multimodal models, and how we can use it to improve them! @lorebasile @ValeMaiorca @DiegoDoimo @FrancescoLocat8
Interested in the semantic specialisation of attention heads in generative models (LLMs/VLMs)? Stop by our spotlight “Head Pursuit” poster at #NeurIPS2025 ! 🗓️ Dec 3 • 11am–2pm PST 📍 Exhibit Hall C/D/E #1013
3
148
Excited to present "The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models" at #NeurIPS2025 and #EurIPS2025! 📍NeurIPS: Poster Session 6 #1114 (Fri Dec 5 4pm-7pm) 📍EurIPS: Poster Session D3 #88 (Wed Dec 3 10:30am-12:30pm) 🧵👇
1
2
2
7
958
🔥 Excited for the start of @NeurIPSConf and @EurIPSConf! We will present several results on interpretability, multimodality and more (🙂) from our Laboratory of Data Engineering @AreaSciencePark DM to chat in San Diego about our work and openings in our Lab Find us here 👇
1
5
255
Alberto Cazzaniga retweeted
Just landed in San Diego to present "Head Pursuit: Probing Attention Specialization in Multimodal Transformers", our spotlight paper @NeurIPSConf! Don't miss poster #1013 on Wednesday, Dec 3 at 11AM. [1/6]
1
5
1
17
1,255
Looking forward to welcoming (virtually :-)) @GiorgosNik02 and @tommaso_mncttn from @EPFL and @GladiaLab at our Laboratory of Data Engineering @AreaSciencePark
🤖Seminar Series Next week, Giorgos Nikolaou and Tommaso Mencattini (@EPFL) will present "Language Models are Injective and Hence Invertible". @GiorgosNik02 @tommaso_mncttn 📅Nov 27, 11 CET (Online) 👉Register to attend: bit.ly/4ieKRYq
5
98
Excited to share that 2/2 papers from our Lab (LADE) were accepted to #NeurIPS2025 (one spotlight 🎉) Great work from all the students and collaborators involved! @AreaSciencePark @aleserra1998 @lorebasile @francescortu @lucrevaleriani @DiegoDoimo @ansuin @FrancescoLocat8
1
8
20
2,284
Special mention to @ValeMaiorca who I forgot in original post 😅
2
246
Alberto Cazzaniga retweeted
Our study is now published on JCIM🎉 We expanded and refined the preprint thanks to the insightful feedback from reviewers! paper: pubs.acs.org/doi/10.1021/acs… code: github.com/RitAreaSciencePar…
1
5
176
🔥 Two PhD positions open @UniTrieste funded by @AreaSciencePark! 🔥 Join the Laboratory of Data Engineering to advance research in AI and its scientific applications. We’re looking for motivated students ready to dive into interdisciplinary research in deep learning and AI.
1
3
3
355
💡 Our interests include (but are not limited to): - AI for biological systems - Reasoning and planning - Interpretability 📍 Location: Trieste, Italy  🚨 🚨 🚨 Deadline: June 6th, 2025
1
1
95
🔗 Apply through the University of Trieste → How to apply lnkd.in/dppFWuGS Deadline is approaching: spread the word, and get in touch for more info! [email protected] LADE website: lnkd.in/dV5sxrxe
78
Really excited to share our latest interpretability work on multimodal models! The communication between image and text is localised in a single token in multimodal-output vision-language models. Paper: arxiv.org/html/2412.06646v1 Happy to discuss it at #NeurIPS2024 More below 👇
🚨🚨 Excited to share our latest paper, now on @arxiv! 🖼️ We studied how unified VLMs, trained to generate both text and images (e.g., @MetaAI's Chameleon), exchange information between modalities, comparing them to standard VLMs. Deep dive:👇
1
3
273
Presenting our work on "The representation landscape of few-shot learning and fine-tuning in large language models" @NeurIPSConf Poster Session East 1 Wednesday 1 h. 11-14 #3303 Great work with @DiegoDoimo @aleserra1998 @ansuin @AreaSciencePark More below
I just landed in Vancouver to present @NeurIPSConf the findings of our new work! Few-shot learning and fine-tuning change the hidden layers of LLMs in a dramatically different way, even when they perform equally well on multiple-choice question-answering tasks. 🧵1/6
1
2
203
Nice start of #NeurIPS2024! Our work with @francescortu and @DiegoDoimo on the Competition of Mechanisms to understand counterfactuality in LLMs featured in the "Causality for LLMs" workshop by @ZhijingJin Check out our ACL2024 paper aclanthology.org/2024.acl-lo…
1
10
271
Congrats @francescortu for the AI prize @UniTrieste! Thesis on how LLMs process false information and how we can steer them towards real facts. #proudsupervisors with @DiegoDoimo & @ZhijingJin ACL24 Paper: aclanthology.org/2024.acl-lo… @AreaSciencePark news: areasciencepark.it/en/a-fran…
1
1
3
630
If you missed out @francescortu and @ZhijingJin presentation at #ACL2024 today, you can still catch up on our work on the Competition of Mechanisms in LLMs at the YouTube or ArXiv links below :-)
Excited to be in Bangkok for my first #ACL2024! 🇹🇭 If you're interested in LLM interpretability, join @ZhijingJin and me to discuss our recent work on the Competition of Mechanisms in LLMs. We'll be presenting at Poster Session N.2 this afternoon from 2:00 to 3:30 pm. 👋"
6
293
Alberto Cazzaniga retweeted
📢Are you a scientist whose work can be applied to reach new heights in the study of pathogens? 👩‍🔬👨‍💻 The International Conference on Pandemic Preparedness is your unmissable chance to connect in a multidisciplinary network 🤝pathogen-ri.eu/conference/#o… 1/4 #prpconference2024
2
21
1
30
6,446
How do Language Models process facts and counterfactuals? In our latest ACL 2024 contribution (arxiv.org/abs/2402.11655) we study the information flow of these mechanisms in LLMs, identifying the components that promote and suppress factual responses. #ACL2024NLP @aclmeeting
🎉🎉 I'm thrilled to announce that our paper, "Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals", has been accepted at the ACL 2024 main conference! 🚨 Check it out here: arxiv.org/abs/2402.11655 👇 #NLProc #ACL2024NLP
1
4
205
Great effort from @francescortu and @DiegoDoimo from our LADE group @AreaSciencePark within a fantastic collaboration with @ZhijingJin @mrinmayasachan and @bschoelkopf from @MPI_IS @ETH_en
104