Pinned Tweet
LLMs can solve tasks one at a time, yet fail when the same tasks are combined into one prompt. Why?
In our paper, we find that LLMs operate under an implicit thinking budget, with the reasoning effort applied to each task shrinking according to a power law.
“On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models” (2610.27190)
Joint work with @ThiesJB, @StefanieJegelka, @sharut_gupta and @AspectStalence (@TU_Muenchen, @MIT, @MunichCenterML). Thank you all for a great collaboration!
#LLM #Reasoning
📄 Paper: arxiv.org/abs/2610.27190
🌐 Project: chenpanli.github.io/fragilit…
💻 Code: github.com/chenpanli/fragili…
🤗 discussion: huggingface.co/papers/2610.2…
