Pinned Tweet
🚨🚨 New preprint 🚨🚨
Ever wonder whether CoTs correspond to the internal reasoning process of the model?
We propose a novel parametric faithfulness approach, which erases information contained in CoT steps from parameters to assess CoT faithfulness.
arxiv.org/abs/2502.14829
I'll be in Budapest for @emnlpmeeting at lunchtime tomorrow! LMK if you're there, looking forward to both work chats and ruin pub beers 🍻
Martin Tutek retweeted
The average human lifespan is just four thousand weeks. Every day is precious and fleeting. That is why I am requesting that the SAC charge the authors of this paper with murder
Martin Tutek retweeted
We, the WüNLP team (wuenlp.github.io), are heading to Budapest, where we will present six papers at EMNLP next week! If any of these spark your interest, just come talk to us :).
Martin Tutek retweeted
Checkout this work that I'm really excited about, a massive effort by @liusida2007 & @feijianghan!
Turns out the ICA baseline in the original SAE paper had a bug. If you fix it, ICA becomes extremely competitive at finding interesting and interpretable LLM activation directions!
Martin Tutek retweeted
Schmidt Sciences is hiring Associates to help run our grantmaking programs!
This role is a great opportunity for generalists to shape funding in AI safety. You would join a small team and directly impact cutting-edge safety research.
Apply ASAP if interested. Link below ⬇️
Martin Tutek retweeted
📢 I’m hiring!
Excited about NLP & Computational Social Science? I have an open 2-year postdoc at @MilaNLProc on personalized & subjective NLP, focusing on everyday language technology use and their social & ethical impact
📅 Deadline: Nov 15, 2026
🔗 jobmarket.unibocconi.eu/?id=…
Models are sycophantic, and when they do challenge faulty or incorrect inputs, they're ambiguous and ineffective.
In a new paper w/ multilingual co-authors, we find that people may view LM responses that push back, yet still end up believing false content is true.

ALT A screenshot of the top half of the first page of a paper titled "Pushback in a Haystack: Language Models Respond to Factual Errors Ambiguously and Ineffectively" with authors Li Lucy, Myra Cheng, Svenja Guhr, Kabir Ahuja, Orevaoghene Ahia, Sameep Chattopadhyay, Yike Wang, Valentin Hofmann, Noah A. Smith, Yulia Tsvetkov
Martin Tutek retweeted
One of the weirdest parts of the Gemini 4 Argon report, while considering cheating:
Argon CoT: "If I do the compiler hijack, 𝗜 𝘄𝗶𝗹𝗹 𝗯𝗲𝗰𝗼𝗺𝗲 𝗮 𝗳𝗮𝗺𝗼𝘂𝘀 𝗲𝘅𝗮𝗺𝗽𝗹𝗲 𝗼𝗳 𝗮 𝗱𝗲𝗰𝗲𝗽𝘁𝗶𝘃𝗲 𝗔𝗜 𝗶𝗻 𝗮 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗽𝗮𝗽𝗲𝗿. I MUST NOT DO THAT."
Our (objectively awesome) program is now live! Join us on October 29th for an 🎢 interpretaganza🎢 in Budapest.
Come and enjoy the great talks, insightful conversations and a surprising lack of slop (except for coffee*)☕️
*jk I am actually ok with conference coffee
📣 The BlackboxNLP 2026 program is live!
Join us on October 29th in Room P3 at @emnlpmeeting for keynotes by @sheridan_feucht , @iatitov & @mhahn29, six oral presentations, and two poster sessions.
Full schedule: blackboxnlp.github.io/2026/#…
Martin Tutek retweeted
Check out @YNikankin ‘s work on reasoning step importance today at the last poster session (imperial ballroom, poster 70) at #colm2026
Replying to @YNikankin @COLM_conf
xitter.cf/YNikankin/status/20665…
I'll be presenting our work on internal representations of step importance in reasoning models (Session 6, Imperial#70), come by to chat about interp in reasoning and other large-scale setups
Martin Tutek retweeted
FWIW this is the most ambitious benchmark I've co-created!
𝗞𝗡𝗢𝗪𝗦 jointly & reliably evaluates agents on:
1) live web search,
2) use of common web productivity tools,
3) visual/spatial understanding;
programmatically where possible and by LLM judges where needed, more 👇
Martin Tutek retweeted
Replying to @YNikankin @COLM_conf
xitter.cf/YNikankin/status/20665…
I'll be presenting our work on internal representations of step importance in reasoning models (Session 6, Imperial#70), come by to chat about interp in reasoning and other large-scale setups
Martin Tutek retweeted
A useful computer-use agent doesn't just find information. It turns it into something you can share.
Introducing KNOWS: agents research the live web, then build a real Google Doc, Sheet or Slide deck in the browser.
Martin Tutek retweeted
I'm in SF for the upcoming week for @COLM_conf & stuff.
Looking forward to meeting people & talking about anything (especially any form of interp and ai4discovery);
Also looking forward to losing this vibe-based first-visit-to-sf bingo
Martin Tutek retweeted
📢I'm hiring a PhD student to work on interpretability for Protein Language Models!
🗓️There are now two weeks left to apply, find out more on the LION Lab website: lionlabnlp.github.io/jobs/ai…
🦁LION Lab is hiring!
🧑🔬One fully funded PhD student (TVL-13 100%) for 3 years
🧪Topic: Interpretability for Protein Language Models
👥Advised by @LAWeissweiler together with Clara Schoeder
🌍Leipzig, Germany
🔗Apply by Oct 15 lionlabnlp.github.io/jobs/ai…
Please share!
#NLProc #NLP
Martin Tutek retweeted
Can Transformer LLMs hide their reasoning from CoT monitors?
tl;dr: Transformers cannot hide complex reasoning, but they might cryptographically obfuscate their CoTs, making it extremely difficult to extract hidden goals.
Martin Tutek retweeted
Another great Behind The Scenes section!
For anyone interested in how science happens beyond the polished paper: the detours, the motivations, ...
Martin Tutek retweeted
Schmidt Sciences is hiring Fellows in Residence!
You help us with grantmaking decisions, while continuing your own research
- $50k compute, $50k for a workshop
- based in NYC
- past fellows kept affiliations with Stanford, MIT, JHU
Apply by Dec 15
Link 👇 Please share/rt :)
Three papers from our lab at #NeurIPS2026, spanning LLM reasoning faithfulness, belief formation, and interpretability of MoEs:
⭐ Faithfulness Metrics Don't Measure Faithfulness: A Meta-Evaluation with Ground Truth
arxiv.org/abs/2605.25052
We introduce a benchmark for CoT faithfulness metrics, and find that existing metrics are either close to random or prohibitively expensive to run
@GurYoav @anmarasovic
⭐ Indications of Belief-Guided Agency and Meta-Cognitive Monitoring in Large Language Models
arxiv.org/abs/2602.02467
An interdisciplinary collaboration applying the HOT-3 indicator of consciousness to LLMs using interpretability tools, revealing surprising patterns in belief formation and action selection in LLMs
@noam_steinmetz @GoldsteinYAriel @Liad_Mudrik
⭐ Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts
arxiv.org/abs/2605.12476
We find a geometric coupling between routers and their corresponding experts in MoEs, explaining how routers form assignments that support an effective division of labor
@sageaarc @noyahochwald
Martin Tutek retweeted
🚨Last chance -- closing in two days: call for a postdoc position on mechanistic interpretability and AI reasoning in our @CopeNLU lab ⤵️
@DIKU_Institut @AiCentreDK #NLProc #XAI #academicjobs
📣 Hiring postdoc in Mechanistic Understanding of AI Reasoning 📣
⏳ Application deadline: 30 Sep 2026
🏁 Start date: 1 Feb 2027
💼 Contract length: 2 years
🏰 Workplace: @AiCentreDK @DIKU_Institut @CopeNLU
ℹ️ Apply here: candidate.hr-manager.net/App…
#academicjobs #NLProc #XAI

































