Postdoc @ University of Zagreb | Working on interpretability & safety of LLMs.

Republic of Croatia
Joined October 2015
🚨🚨 New preprint 🚨🚨 Ever wonder whether CoTs correspond to the internal reasoning process of the model? We propose a novel parametric faithfulness approach, which erases information contained in CoT steps from parameters to assess CoT faithfulness. arxiv.org/abs/2502.14829
2
10
4
60
10,584
I'll be in Budapest for @emnlpmeeting at lunchtime tomorrow! LMK if you're there, looking forward to both work chats and ruin pub beers 🍻
2
24
627
Martin Tutek retweeted
The average human lifespan is just four thousand weeks. Every day is precious and fleeting. That is why I am requesting that the SAC charge the authors of this paper with murder
3
18
248
10,952
Martin Tutek retweeted
We, the WüNLP team (wuenlp.github.io), are heading to Budapest, where we will present six papers at EMNLP next week! If any of these spark your interest, just come talk to us :).
4
10
389
Checkout this work that I'm really excited about, a massive effort by @liusida2007 & @feijianghan! Turns out the ICA baseline in the original SAE paper had a bug. If you fix it, ICA becomes extremely competitive at finding interesting and interpretable LLM activation directions!
check out this intuitive video on why interpretable directions in llms look non-gaussian, how ica finds them in minutes per layer, and the evaluation bug that made ica look weak for 3 years
3
10
69
2,794
Martin Tutek retweeted
Schmidt Sciences is hiring Associates to help run our grantmaking programs! This role is a great opportunity for generalists to shape funding in AI safety. You would join a small team and directly impact cutting-edge safety research. Apply ASAP if interested. Link below ⬇️
6
19
144
12,116
Martin Tutek retweeted
📢 I’m hiring! Excited about NLP & Computational Social Science? I have an open 2-year postdoc at @MilaNLProc on personalized & subjective NLP, focusing on everyday language technology use and their social & ethical impact 📅 Deadline: Nov 15, 2026 🔗 jobmarket.unibocconi.eu/?id=…
12
1
31
2,078
Martin Tutek retweeted
Models are sycophantic, and when they do challenge faulty or incorrect inputs, they're ambiguous and ineffective. In a new paper w/ multilingual co-authors, we find that people may view LM responses that push back, yet still end up believing false content is true.
2
21
2
98
4,724
Martin Tutek retweeted
One of the weirdest parts of the Gemini 4 Argon report, while considering cheating: Argon CoT: "If I do the compiler hijack, 𝗜 𝘄𝗶𝗹𝗹 𝗯𝗲𝗰𝗼𝗺𝗲 𝗮 𝗳𝗮𝗺𝗼𝘂𝘀 𝗲𝘅𝗮𝗺𝗽𝗹𝗲 𝗼𝗳 𝗮 𝗱𝗲𝗰𝗲𝗽𝘁𝗶𝘃𝗲 𝗔𝗜 𝗶𝗻 𝗮 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗽𝗮𝗽𝗲𝗿. I MUST NOT DO THAT."
With Gemini 4 Argon we are so back, on the one metric that really matters: length of our safety report! The Argon safety report is Google's most thorough by far and IMO there's a lot of good content, I particularly like the loss of control, alignment & monitorability assessments
80
166
36
2,558
105,643
Our (objectively awesome) program is now live! Join us on October 29th for an 🎢 interpretaganza🎢 in Budapest. Come and enjoy the great talks, insightful conversations and a surprising lack of slop (except for coffee*)☕️ *jk I am actually ok with conference coffee
📣 The BlackboxNLP 2026 program is live! Join us on October 29th in Room P3 at @emnlpmeeting for keynotes by @sheridan_feucht , @iatitov & @mhahn29, six oral presentations, and two poster sessions. Full schedule: blackboxnlp.github.io/2026/#…
5
25
891
Martin Tutek retweeted
Check out @YNikankin ‘s work on reasoning step importance today at the last poster session (imperial ballroom, poster 70) at #colm2026
xitter.cf/YNikankin/status/20665… I'll be presenting our work on internal representations of step importance in reasoning models (Session 6, Imperial#70), come by to chat about interp in reasoning and other large-scale setups
5
21
1,107
Martin Tutek retweeted
FWIW this is the most ambitious benchmark I've co-created! 𝗞𝗡𝗢𝗪𝗦 jointly & reliably evaluates agents on: 1) live web search, 2) use of common web productivity tools, 3) visual/spatial understanding; programmatically where possible and by LLM judges where needed, more 👇
A useful computer-use agent doesn't just find information. It turns it into something you can share. Introducing KNOWS: agents research the live web, then build a real Google Doc, Sheet or Slide deck in the browser.
2
1
27
4,153
Martin Tutek retweeted
xitter.cf/YNikankin/status/20665… I'll be presenting our work on internal representations of step importance in reasoning models (Session 6, Imperial#70), come by to chat about interp in reasoning and other large-scale setups
Do reasoning models internally represent abstract properties of their own chain of thought (such as "which steps are important"), while not surfacing these properties in their tokens?
7
1
17
1,631
Martin Tutek retweeted
A useful computer-use agent doesn't just find information. It turns it into something you can share. Introducing KNOWS: agents research the live web, then build a real Google Doc, Sheet or Slide deck in the browser.
2
6
3
21
2,719
Martin Tutek retweeted
I'm in SF for the upcoming week for @COLM_conf & stuff. Looking forward to meeting people & talking about anything (especially any form of interp and ai4discovery); Also looking forward to losing this vibe-based first-visit-to-sf bingo
4
4
46
1,320
📢I'm hiring a PhD student to work on interpretability for Protein Language Models! 🗓️There are now two weeks left to apply, find out more on the LION Lab website: lionlabnlp.github.io/jobs/ai…
🦁LION Lab is hiring! 🧑‍🔬One fully funded PhD student (TVL-13 100%) for 3 years 🧪Topic: Interpretability for Protein Language Models 👥Advised by @LAWeissweiler together with Clara Schoeder 🌍Leipzig, Germany 🔗Apply by Oct 15 lionlabnlp.github.io/jobs/ai… Please share! #NLProc #NLP
5
15
888
Martin Tutek retweeted
Can Transformer LLMs hide their reasoning from CoT monitors? tl;dr: Transformers cannot hide complex reasoning, but they might cryptographically obfuscate their CoTs, making it extremely difficult to extract hidden goals.
3
28
1
126
6,284
Martin Tutek retweeted
Another great Behind The Scenes section! For anyone interested in how science happens beyond the polished paper: the detours, the motivations, ...
[New preprint] How do images in VLMs align with words? In this work, we found a set of attention heads responsible for OCR. But to our surprise, these heads were actually able to verbalize much more than just text. So, we used them to create a simple logit lens for image tokens!
2
2
22
1,680
Martin Tutek retweeted
Schmidt Sciences is hiring Fellows in Residence! You help us with grantmaking decisions, while continuing your own research - $50k compute, $50k for a workshop - based in NYC - past fellows kept affiliations with Stanford, MIT, JHU Apply by Dec 15 Link 👇 Please share/rt :)
3
45
235
28,829
Martin Tutek retweeted
Three papers from our lab at #NeurIPS2026, spanning LLM reasoning faithfulness, belief formation, and interpretability of MoEs: ⭐ Faithfulness Metrics Don't Measure Faithfulness: A Meta-Evaluation with Ground Truth arxiv.org/abs/2605.25052 We introduce a benchmark for CoT faithfulness metrics, and find that existing metrics are either close to random or prohibitively expensive to run @GurYoav @anmarasovic ⭐ Indications of Belief-Guided Agency and Meta-Cognitive Monitoring in Large Language Models arxiv.org/abs/2602.02467 An interdisciplinary collaboration applying the HOT-3 indicator of consciousness to LLMs using interpretability tools, revealing surprising patterns in belief formation and action selection in LLMs @noam_steinmetz @GoldsteinYAriel @Liad_Mudrik ⭐ Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts arxiv.org/abs/2605.12476 We find a geometric coupling between routers and their corresponding experts in MoEs, explaining how routers form assignments that support an effective division of labor @sageaarc @noyahochwald
4
16
132
5,350
🚨Last chance -- closing in two days: call for a postdoc position on mechanistic interpretability and AI reasoning in our @CopeNLU lab ⤵️ @DIKU_Institut @AiCentreDK #NLProc #XAI #academicjobs
📣 Hiring postdoc in Mechanistic Understanding of AI Reasoning 📣 ⏳ Application deadline: 30 Sep 2026 🏁 Start date: 1 Feb 2027 💼 Contract length: 2 years 🏰 Workplace: @AiCentreDK @DIKU_Institut @CopeNLU ℹ️ Apply here: candidate.hr-manager.net/App… #academicjobs #NLProc #XAI
9
23
3,699