πŸ„πŸ»β€β™‚οΈ Luke Cheng (@_lukecheng) header
πŸ„πŸ»β€β™‚οΈ Luke Cheng (@_lukecheng) profile picture

seeking knowledge (and theoretical neuro) @Columbia Masters Comp Neuro @Tuebingen ✨🧠🌎

NYC / this side of the web
Joined June 2009
🧡 New preprint! "A mathematical theory of balancing relational generalization and memorization" With @SamuelLippl Real-world learning requires both learning rules AND memorizing exceptions. We introduce a task + theory for understanding how learning systems do both. arxiv.org/abs/2605.22972
2
1
403
Bonus: finetuned LLMs show human-like behavioral signatures on TI: symbolic distance effects, endpoint effects, and content effects (better on real poker than reversed poker).
1
41
We think that dealing with exceptions is a fundamental challenge for learning in the wild. TI w/ exceptions gives a controlled, analytically tractable way to study it. Even simple linear readout models can generalize with the right representational geometry; but counterintuitively, regularization always hurts.
36
I think people think that non-attachment leads to not caring, when in fact it can just lead to continuous motion, which is what actually caring looks like. You can move from moment to moment without sinking into the trap of negative minima or rumination or artless circling.
1
1
1
397
a system is one that's "perfect". Instead, a working system comes from iterative noting. That's probably the lesson I learned from mathematics. You can start to construct a particular logic that works, not just from axioms but from experience.
1
204
They're all approximations but making the systems lets you create your own feedback loops. The system perspective sits on the background though. The fun part is in building up iteratively. It feels like a particular sense of agency and aliveness.
168
πŸ„πŸ»β€β™‚οΈ Luke Cheng retweeted
Take a break on trying to solve the problem and just describe the problem as clearly as you can.
7
30
3
371
9,556
πŸ„πŸ»β€β™‚οΈ Luke Cheng retweeted
gm - What is your life's work? - What's the most ambitious thing you can do? - If you had 10x more agency, what would you do?
received an incredible call from someone i deeply respect and admire last week, mainly urging me to work on the most ambitious thing. grateful to have this kind of support.
2
2
26
3,620
A couple hard hours thinking about a math problem seemingly opens up so many pathways
1
146
(prelim thts) Wow o1 pro is like an on call tutor for undergrad 4000 level math (measure theory, differential geometry). Possibly 10x better because you can just continue revising when you don't understand. I don't see any reason for someone to pay for tutors at this lvl.
181
Being able to read when you understand nothing, handling the emotional impact instead of distracting oneself, precisely gain understanding on each word/definition, and then just seeing what logically follows is super understated
2
334