
seeking knowledge (and theoretical neuro) @Columbia Masters Comp Neuro @Tuebingen β¨π§ π
NYC / this side of the web
Joined June 2009
- Tweets2.1K
- Following170
- Followers270
- Likes2.2K
π§΅ New preprint! "A mathematical theory of balancing relational generalization and memorization"
With @SamuelLippl
Real-world learning requires both learning rules AND memorizing exceptions. We introduce a task + theory for understanding how learning systems do both.
arxiv.org/abs/2605.22972
Bonus: finetuned LLMs show human-like behavioral signatures on TI: symbolic distance effects, endpoint effects, and content effects (better on real poker than reversed poker).
1
41
We think that dealing with exceptions is a fundamental challenge for learning in the wild. TI w/ exceptions gives a controlled, analytically tractable way to study it.
Even simple linear readout models can generalize with the right representational geometry; but counterintuitively, regularization always hurts.
36
I think people think that non-attachment leads to not caring, when in fact it can just lead to continuous motion, which is what actually caring looks like. You can move from moment to moment without sinking into the trap of negative minima or rumination or artless circling.
a system is one that's "perfect". Instead, a working system comes from iterative noting. That's probably the lesson I learned from mathematics. You can start to construct a particular logic that works, not just from axioms but from experience.
1
204
ππ»ββοΈ Luke Cheng retweeted
Take a break on trying to solve the problem and just describe the problem as clearly as you can.
ππ»ββοΈ Luke Cheng retweeted
gm
- What is your life's work?
- What's the most ambitious thing you can do?
- If you had 10x more agency, what would you do?
(prelim thts)
Wow o1 pro is like an on call tutor for undergrad 4000 level math (measure theory, differential geometry). Possibly 10x better because you can just continue revising when you don't understand.
I don't see any reason for someone to pay for tutors at this lvl.
181




