I printed my town.
USGS 3DEP 1 meter bare-earth digital elevation model.
2,600 x 1,596 meters. ~200 meters of elevation.
1
1
32
Progressive 2d fft focusing of raw umbraspace sar compensated phase history using python🐍. The earliest frames show sinc/Fresnel ripples before the radar accumulated enough energy to form an image. I noticed it looked like the fft of a linear chirp.
35
nanogpt by @karpathy on webgpu generating QKV vectors while it streams
i can inspect any query, key, or value, swap layers, and heads
47
Most civilizations die around 300 years. Pharaonic Egypt, and Rome are rare outliers. Their natural defenses, internal structures, and no small amount of luck allowed them to pass the filter.
America has all the geographic advantages, and its industry is the most powerful ever. But it’s uniquely vulnerable to infiltration, and our immune system has been weakened from within.
3
46
Learning with LLMs protip: deep dive a topic until you have a tenuous grasp on it, then instruct the model to quiz you socratically until you understand it. Do this before the compaction window.
2
90
adam retweeted
USB-C has 24 pins, and at least 12 different ways to take them over.
DisplayPort, Thunderbolt, an HDMI mode nobody built, a VR standard that died in 2 years, and hidden ones from Apple and Nintendo.
Here's which pins each one takes.
Kids don’t like reading Shakespeare because it’s presented as a way to learn English. It should be presented as a way to examine the human condition. Shakespeare is meant to be ACTED, not read and memorized like a textbook.
Replying to @luke_winkie
This story also includes quotes from my 7th grade English teacher who changed my life. One of my favorite ever interviews…
1
122
adam retweeted
18 of the 20 best open models today are Mixture-of-Experts. Dense is basically over.
And yet the know-how to train a good MoE still lives mostly in the heads of a handful of teams.
So we spent 800k GPU hours running the experiments ourselves and wrote everything down. Super happy to finally release "The Ultimate MoE Training Handbook", free and open, organized around the questions training teams hit:
- how many experts, how big, shared or not?
- why is half my step spent in all-to-all, and how do I hide it?
- why is my run 25x slower with no error in the logs?
- softmax, sigmoid or sqrt(softplus) router, and why keep it in fp32?
- aux loss or DeepSeek's loss-free bias?
- upcycle a dense checkpoint or train from scratch?
- can I serve with fewer experts per token than I trained with?
⚠️ Warning: it's long (~70k words, budget a few days, sorry) but with 55 interactive figures, code you can run and numbers from our own runs.
Read it here: huggingface.co/spaces/huggin…
adam retweeted
Replying to @I_am_Bhu_shn
Because time is a product which is also physically represented as expansion, and local expansion due to recurrent structures has the same geometric effect locally experienced as time and gravity.
On mobile, set it to flat and scrub
I was interested in an absolute scale to measure the morphing ideologies of American politics. @bot mapped elections back to the start, using the political platforms of that election to define one dimension. Scrub in 4D. Mouse for more info. I've not validated each point.
80
I was interested in an absolute scale to measure the morphing ideologies of American politics. @bot mapped elections back to the start, using the political platforms of that election to define one dimension. Scrub in 4D. Mouse for more info. I've not validated each point.
The masculine urge to abandon corporate life for the smoke
For fifty eight years, my boss in Tokyo believed that beef should be sliced as thin as paper.
In Japan, we cook thin meat for four seconds in boiling broth. That is our way.
Then last month, the YouTube algorithm showed Director Sato a video of a man in Texas smoking a brisket.
It changed his life.
On Monday morning, he called me to his desk. His eyes were bloodshot.
"Have you seen this?" he whispered, turning his monitor toward me. "The American pitmaster does not sleep for sixteen hours. He sits by the fire in the dark. He guards the meat like a castle."
I said, "Sir, it is just a barbecue."
He slammed his hand on the desk.
"This is not cooking," he said. "This is a vigil."
Last Saturday was our annual company picnic by the river in Kanagawa. Normally, we grill thin meat and yakisoba for two hours and go home at 2:00 PM.
I arrived at 9:30 AM to help set up.
Director Sato was already there.
I want to be accurate here: he had been sitting in a folding chair since 10:00 PM on Friday night. He was wearing a towel around his head and staring at a massive black barrel smoker he had imported from Oklahoma.
Inside I said: THIS MAN HAS ABANDONED CORPORATE LIFE FOR THE SMOKE.
When we tried to help him, he held up a pair of metal tongs and clicked them twice.
"Step back," he said calmly. "The stall has begun. Nobody opens the lid."
Twelve Japanese accountants stood in complete silence around a barrel for four more hours. Nobody dared to eat a single noodle until he gave the signal.
At 1:45 PM, he sliced the meat. It fell apart on the cutting board.
My boss looked at the pink smoke ring, nodded once, and wiped a single tear from his cheek.
He has already submitted an official budget request for a trailer smoker for next fiscal year.
1
4
99










