ʤeɪmz (@squaredcurve) profile picture

up and to the right

Joined October 2010
How it feels to ask the Chinese ai models for help on something Claude won’t agree to
205
3,597
173
62,473
1,034,661
Artists: but I don't want to lose my job. I love it. Mathematicians: but I don't want to lose my job. I love it. Economists: LONG HAVE I AWAITED THIS HOUR! DESTROY ME, EFFICIENCY, AND LET UTILIZATION-ADJUSTED TOTAL FACTOR PRODUCTIVITY RISE ON THE WIND OF MY ASHES!
107
1,208
100
15,425
414,552
"He is a horrified gardener watching humanity gorge on its seed corn."
People clowning on him don’t understand what he’s saying. All the wealth of humanity to date supports perhaps 250k living math phds. Roughly the population of St. Louis, Missouri. The training pipeline for that group has been irreparably shattered in the last month. A phd is supposed to make an original contribution to their field to graduate. That’s just…. not possible anymore. 938 years after the founding of the first university in Bologna… Do universities now reward… teaching ? comprehension of something discovered by a machine? application ? do mathematicians become quotidian (gasp of disgust) engineers? Tao is upset because he knows none of those outside the field care about its future. He is a horrified gardener watching humanity gorge on its seed corn. It is irreparable of course. The old way is dead dead. We live in the short interregnum before the new king is born: a Lean crawler that spawns a billion copies exploring every corner of math latenspace. So much math to understand that even if 8 billion humans had the ability of the 250k mathematicians alive today, it would still take a million years to comprehend. It is ironic and sad.. because Tao himself is a pioneer of collaborative math: math that is understood by a combination of minds rather than an pindividual. The tools that Tao began exploring a few years ago, solving problems through blog posts and using Lean to guarantee each mind’s contribution stood on its own when assembled into the greater truth, have been turned against him. Math’s path to utilize multiple minds didn’t restrict access to human minds, and now the machines have blitzkrieged themselves into the heart of the matter. The agents use rudimentary message boards, working 10,000 to a task, tirelessly, using Lean to verify the correctness of each contribution. It was good while it lasted… and now it’s gone.
1
61
just in case anyone in IT is sleeping well at night:
Ever wanted an AI that doesn't just talk cybersecurity but actively helps you break into systems? Meet GLM-5.3-CYBERSECURITY-FP8, a specialized text-generation model for offensive security, red teaming, and pentesting. It's refusal-removed, so it's built to assist without holding back. #AI #CyberSecurity
46
I don't know who needs to hear this, but if you homeschool, you don't need to spend 6+ hours per day doing it. Public school should not be your model. What a typical homeschool day might look like: - Kids wake up 8:30 - 9:00 - Kids start school around 10:00 - Kids are usually done by lunchtime. Sometimes they go a little bit after. Rest of the day is free. - At night, the family reads together for 45-60 minutes. Sometimes we go to the zoo. Sometimes we take walks. Sometimes they have an online class. Sometimes they do nothing extra. One day a week we go to our co-op and spend time with other families. They usually do a science experiment. As kids reach middle school, they take on more responsibility for themselves, and school lasts a bit longer per day. But at that point, your personal involvement doesn't increase drastically. You already helped them grow and spread their wings. They can fly a bit on their own.
254
1,226
54
10,582
490,813
One of the best predictors of how successful a child will be is the amount of time they spend reading Parents should start reading with their kids as early as possible, even before they understand the words. This should be a daily activity. This is the best way to build a love for reading. Kids who grow up reading every day develop stronger communication skills & have more success in school And parent-child reading time is a great way to build strong bonds. One day your kids will thank you for building this habit
20
234
8
1,611
110,889
Memory is the raw material of understanding, and we use it to build magnificent information structures in our brains. But when the towers grow high enough, intricate enough, we often look upon them as so magnificent, so divine, that we later claim they could not have emerged out of raw mechanical memory. Our claims of "learning is not memorization" may sound poetic in the abstract, but when asked to break them down concretely, we find our explanations start to sound more and more like "tower-building is not nailing wood, not welding steel, not balancing load, it is none of those mechanical things, it is the emergent grace of brushing the heavens." Which is completely devoid from instructional value, and entirely unhelpful to any aspiring tower-builder -- aside from possibly inspiring a fleeting spark of motivation that spends itself searching for a place to spend itself. At the end of the day, learning is memory. Understanding amounts to memory that is well-connected and deeply ingrained. The difference between "just memorizing" and "deeply understanding" isn't the substrate of the representation, it’s the depth of the representation. Deep understanding consists of not only declarative facts, but also connections that link facts into related groups or "chunks" (think: concepts), connections that link smaller chunks into bigger chunks, and so on – as well as procedures for operating on chunks (think: skills), connections that chunk sub-procedures into meta-procedures, and so on. This is all raw mechanical memory. It's just storage and retrieval of information. The point of building superior representation is to build superior recall abilities, including broadening and fine-tuning the range of stimuli that activate the information. If someone is "just memorizing" as opposed to "deeply understanding," it really means they haven't stored enough information in memory. "Learning is memory" might feel obvious, but many learners don’t fully grasp the implications. If you don't realize that learning is memory, then you won’t realize that the most effective way to learn is to use memory-supporting training techniques. It’s easy to get confused, thinking: "Truly understanding something is different from just memorizing it, so learning doesn’t require memory-focused techniques like retrieval practice, spaced review, and interleaving (mixed practice). Those are about memorization, not true understanding." And if that's what you think, then you'll likely shirk the hard work required to build memory, use fun/easy but ineffective training techniques instead, and end up not actually learning much. I used to think resistance to "learning is memory" was genuine confusion, but now I think it's mostly laziness. If you accept that learning is memory, then you have to accept that maximizing learning requires memory-supporting training techniques. But those techniques are highly effortful and measurable, which make them unattractive to low-accountability / low-effort folks. The only way to reject the premise is to latch onto the idea that "understanding" is some supernatural thing that can't arise from raw mechanical memory. Which is problematic because there's decades of research showing how expertise arises from having lots of domain-specific information encoded into memory that is well-connected and deeply ingrained. (A response to the most common genuine objection: Even learning to generate new ideas amounts to searching a space of possibilities, combining pieces of memory in ways that haven’t been combined before. Now you might say "aha, the skill of searching/combining is something other than memory," but let me ask you: when a someone trains the skill of coming up with novel ideas, such as a grad student learning to come up with research ideas that contribute to the cutting edge of knowledge in the field, where is that skill stored for future use? In memory.)
I think experts carry knowledge in their long-term memory for so long that recalling it feels automatic. Because of this automaticity, they don't recognize it as something they’ve memorized. And then they tell people that memorization is not important for learning.
8
28
3
192
17,678
ʤeɪmz retweeted
this is the future of education
148
945
282
8,357
714,895
Space travel involves a Navigator tripping balls so hard on Spice that reality just accepts that the ship he's in is now in another part of the galaxy.
2
11
115
3,565
Anyways, the Internet took this weird bit of kabbalistic miracle technology and immediately used it to make anime waifus with huge breasts instead of pondering the meaning of life and the universe. Great job, everyone, well done.
37
92
43
1,342
111,069
I just attended a talk on the mathematics of diffusion image generation models and it blew me away. Takeaways: 1. The math is very “simple” 2. In fact, it’s so simple that this method *shouldn’t really work* 3. The fact it does says something very fundamental about the universe
60
341
68
3,985
772,232
Surprisingly little AI progress in 2023 so far. What’s going on??
117
272
40
4,554
648,560
On Pre-Jackson Tolkien / Middle Earth Aesthetica This will not be an exhaustive art post, but rather, a meditation on how pre-Jackson LOTR aesthetics help maintain the mystery of Middle Earth for me as I grow older. Let us seek lost lands:🧵
98
1,006
104
7,867
This guy wins at Linkedin
386
13,473
1,454
94,049
for all my fellow geriatric millennials. sound on – at Brooklyn, NY
2,413
32,101
9,364
144,322
Magestical blow! It’s almost a year since the volcano erupted. To celebrate I plan to release some old and never published videos over the next few weeks. Hope you like it! #SharingIsCaring
184
3,687
531
13,804
mfs get a macbook and all of a sudden they got work to do in public places
838
20,168
3,607
284,501
The public are excited by the images, but astronomers are as excited by the spectra, like this one. I want to talk about why
219
5,243
569
31,873