Such an interesting training set. Looking forward to trying it out.
Z.ai chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) during a lecture at Tsinghua University today.
Instead of relying on public datasets, their pretraining pipeline pulls from six separate internal engines:
- Web: 1 trillion pages crawled at ~10B pages/day with PB-scale template clustering
- Documents: 2 billion scientific PDFs parsed through GLM-OCR (4x faster with speculative decoding)
- Books: 50 million books with layout reordering and garbled-text filtering
- Code: 500 million repositories turned into executable tasks with real tests and issue descriptions
- Video: 10 billion videos for long-sequence world knowledge
- Audio: 300 million hours rewritten via ASR into trillions of tokens
15
This is called narrative distortion. Grow tired of the naysayers. Objectivity is so rare these days. Echo chambers are growing in numbers.
🚨 WOW! Elon Musk FIRES BACK at every Senate and House Democrat planning to target him, saying he will GLADLY cancel any government contract — he doesn't NEED them anyway
"SpaceX contracts with the government are BOTH the best product AND the lowest price! Moreover government revenue will be less than 10% of SpaceX revenue this quarter and less then 5% a year from now. Happy to cancel any that the government doesn’t want. Just say the word!"
Honestly, pushing away Elon Musk is a HORRIBLE move from Dems! His products are incredible and benefit America 🇺🇸
12
Justin Podhola retweeted
🚨 WOW! Elon Musk FIRES BACK at every Senate and House Democrat planning to target him, saying he will GLADLY cancel any government contract — he doesn't NEED them anyway
"SpaceX contracts with the government are BOTH the best product AND the lowest price! Moreover government revenue will be less than 10% of SpaceX revenue this quarter and less then 5% a year from now. Happy to cancel any that the government doesn’t want. Just say the word!"
Honestly, pushing away Elon Musk is a HORRIBLE move from Dems! His products are incredible and benefit America 🇺🇸
Yet, the Long Term Holders are near all time high. Diamond hand holders could never be higher. Keep wishing Peter.
Bitcoin is finally breaking down. It's hard to believe it's held up this long. Now that it's below $80K, the next stop is likely $75K. If that level fails to hold today, it's going to be a very long weekend for Bitcoiners, especially for ETF investors who can't sell until Monday.
18
I literally spit out my water when I read this.
How can someone be so naive and dense? I guess ignorance is bliss.
Hi @elonmusk , we’ve conducted the most comprehensive study to date on tax unfairness in the United States.
We found that you, like your fellow billionaires, pay a lower effective tax rate than the average American.
So if you really want to help the American people, I have a better suggestion than charity: pay more taxes. 🧵
20
I want to be very clear, this is one of the most meaningful things that one can do that the government has not been able to do in over... (I do not know even how long). This shows amazing character @elonmusk
On a very sincere note: Bravo my man.
Next year, I will give one of my SpaceX shares to every kid in America.
This will be the first of many.
12
Justin Podhola retweeted
These billionaires often appear in front of AI rooms… beautiful but totally fake.
They should build the real rooms.
Less simulacra more authentic beauty
Can't wait to visit ;)
Replying to @Scobleizer
True.
You will be able to ask the Roadster to perform any of the tricks shown autonomously, as it will be sentient.
Also, we will have a wild looping track (crazier even than Hot Wheels) at our Texas HQ where you can test out your Roadster.
11
That is exactly right. No use pretending that one is perfect. Humans are literally made imperfect.
13
Justin Podhola retweeted
LIVE: 🇺🇸 Crypto Clarity Act Senate Cloture Vote
teapawt.net/i/broadcasts/1yxBePBqE…
I know it will not happen anytime soon, But these should be brought to Colorado!
I've now done a total of 3 hours riding around in @Tesla’s Cybercab and spent a total of $92.51. That travel time would have cost me $200 with Ubers.
My longest ride has been ~40 minutes. I legitimately can't come up with any major complaints for FSD V15. None. I’ve spoken to a handful of other people here who say the same.
I didn't need to call rider support once. No weird maneuvers, jitteriness, or hesitation. I do think pickup and drop-off locations could use some tweaking (same for Model Y) as you need to walk a bit sometimes, but I think that will get better as V15 progresses.
Two things you surprisingly get used to very quickly are having no rearview mirror and no side mirrors.
For anyone else trying Cybercab for the first time, I encourage you to recline your seat all the way back and just close your eyes for a minute. Realizing that you can nap in the spot where a driver traditionally sat while the car drives you around with no steering wheel or pedals is a pretty surreal feeling.
43
I simply wish that this would be the narrative, I do not understand, and I never will, why one gets punished for providing amazing things for Americans. SUPER dumb if you just let that statement sink in for a moment. @elonmusk there are good and reasonable people who get it.
Replying to @BasedMikeLee
I have stock in SpaceX and Tesla, not some big pile of cash.
As my companies do more and more useful things, their value increases proportionate to their projected usefulness. All shareholders benefit along the way, including most retirement programs.
39
















