Chong W. (@cw_aabc) profile picture

A human being

Washington, USA
Joined October 2018
Photo by Chong W. (@cw_aabc)
Meet Clover-35B-A3B-Preview ๐Ÿ€ the first open-weight production diffusion language model (dLLM) with 35B total parameters capable of 680 tps on a single card at BF16. Clover exhibits strong performance against both dLLM and AR models and is available today at @huggingface @ModelScope2022 and at our website
67
116
87
962
182,866
Replying to @BachFrancis
(1/7) I'd like to provide some additional context for the remarks that can be found in this interview. (2/7) My discomfort with the attention being paid to existential risk---and with the ongoing dominance of the public discussion of such risks by a few so-called thought leaders---is that there's an elephant in the room that is being missed. That elephant is the effect of all of this discussion on young people, and indeed the effect---beginning with social media a decade ago---of information technology on young lives broadly speaking. (3/7) I recently read an interview by Jill Lepore in which she reports on discussions that she had recently with a group of college students: "They had just three things to say. One, social media completely destroyed their childhoods. Two, AI is destroying their college education and their likely prospects for employment. And three, what the hell are we all doing?" To add a fourth bullet that I've heard in similar discussions: "I'm not going to have children, because the existential risk is just too high." (4/7) Please contemplate such a statement, those of you who think that it's OK that the public, widely diffused, discussion coming from seemingly authoritative figures is so adamant about existential risk. (5/7) Let me add that I have little interest in a debate about what "superintelligence" might mean, or whether we're currently seeing the emergence of superintelligence. For what it's worth, I would certainly agree that the solution of extremely challenging math problems (for example) exhibits a very impressive form of intelligence, although I would want to argue that such intelligence is impossible to dissociate from the collective of humans that provided data to the machine learning system (which itself has become a kind of collective). (6/7) Such philosophical debates are entertaining and even important, but when they then head in the direction of "when such superintelligence emerges, there's a good chance that it will want to kill all humans", I say "science fiction". Again, I don't think that it's bad to consider such thoughts, but I strongly believe that it's bad for society, and especially young people, for such thoughts, unaccompanied by any serious real-world analysis, to become a dominant form of discourse of the era. (7/7) We are damaging human lives, and the consequences of that damage will no doubt be a major theme of the next several decades.
48
234
61
1,202
152,618
๐Ÿ“œ Paper on new pretraining paradigm: Synthetic Bootstrapped Pretraining SBP goes beyond next-token supervision in a single document by leveraging inter-document correlations to synthesize new data for training โ€” no teacher needed. Validation: 1T data + 3B model from scratch.๐Ÿงต
10
48
4
257
42,256
In this report we describe the 2025 Apple Foundation Models ("AFM"). We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device AFM model. machinelearning.apple.com/reโ€ฆ
497
92
13
462
71,072
I just built Apple Intelligence Chat ๐Ÿš€. It uses the new Foundation Models Framework to let you chat offline with the Apple Intelligence model on iOS 26. Let me know if you'd like the code and i'll make it open source. And yes the UI uses Liquid Glass ๐ŸงŠ
28
21
2
277
38,809
Chong W. retweeted
On behalf of the whole team I'm so proud to introduce the Foundation Models framework, an API to access our on-device LLM! Check out the Platforms State of the Union for an introduction and 4 sessions later today! developer.apple.com/news/?idโ€ฆ #WWDC25
14
45
7
249
25,861
At WWDC we introduce a new generation of LLMs developed to enhance the Apple Intelligence features. We also introduce the new Foundation Models framework, which gives app developers direct access to the on-device foundation language model. machinelearning.apple.com/reโ€ฆ
89
106
14
482
80,912
As Apple Intelligence is rolling out to our beta users today, we are proud to present a technical report on our Foundation Language Models that power these features on devices and cloud: machinelearning.apple.com/reโ€ฆ. ๐Ÿงต
9
184
33
698
161,531
Our team is developing cutting-edge foundation models that power Apple Intelligence. Join our close-knit and fast-moving efforts as researchers and engineers in Cupertino, New York, or Seattle. Be at the heart of shaping the future of Apple Intelligence. Learn more at jobs.apple.com/en-us/search?โ€ฆ.
Earlier today at #WWDC24, we introduced Apple Intelligence, the personal intelligence system integrated deeply into iPhone, iPad, and Mac, to enable powerful capabilities across language, images, actions, and personal context. Weโ€™re excited to share more about how Apple Intelligence models have been built and adapted to perform specialized tasks efficiently, accurately, and responsibly on Appleโ€™s ML Research site:ย machinelearning.apple.com/reโ€ฆ
14
99
20,210
Chong W. retweeted
Transcript from one of the festival survivors about what happened: "I was there at the festival, there were rockets so people got nervous and everyone started to leave, We drove towards the main road, where we saw many cars standing in what looked like a traffic jam, at the end there were policemen and soldiers forming a roadblock and blocking the road. This was not a police checkpoint, these were terrorists impersonators. They waited until there were a lot of people standing in traffic then pulled out a machine-gun and started spraying the cars with bullets, at least 300 dead. 300 people gone, what they say on the news is wrong. We were the last car, so we drove reverse. We took two bullets to the windshield, a bullet penetrated Lior in the shoulder and I was injured by broken glass in my hands. We managed to get away from them with the car barely working, we opened waze and Lior told me "I served here, let's go to the military base: Gaza division." Driving towards the division's base, we were sure that we will be safe there. But they already raided this base at night and killed all the soldiers of the base in their beds, by then they had already taken over the base. We arrived at the gate with the car all broken. I saw at the gate's entrance what I was sure were soldiers but actually were 13 terrorists standing ready in crouch position with AK47s and M16s looking at us from a range of about 20 meters then started spraying the hell out of our car. We were shot all over, all the door were holes, a bullet hit me in the head, tore a part of my head off. Evyatar took a bullet in the pelvis, Lior to the shoulder. We're all in blood, they threw a grenade at us, suddenly I didn't hear anything, looking to the right, to the left shouting, "Lior get out". I garbed Lior and got out of the car, we started running and they kept shooting at us, I heard the bullets pass near my head and kept taking shots near my legs, I still have shrapnel in my legs from the bullets. We ran and saw the fence of the base, it was about three meters high, we jumped over it through the barbed wire, all my hands were cut. They kept shooting at us, but not a single bullet hit us, they didn't manage to hit us somehow. We kept running, and hid there in the snipers' bunker, We were there for about 3-4 hours, without water, bleeding, I made myself a tourniquet, Lior also made a tourniquet. We were sure the rest were already dead behind, I didn't look back. Then a team of Shayetet 13 (Israeli navy seals) arrived at the base, and real war started inside, some additional 30-40 soldiers were gone. I heard the screams of death, pull back, pull back, death, they were shooting RPGs at each other, right in the middle of the war we were. We finally went out to them, we were afraid that our soldiers would shoot at us because we looked like terrorists with shirts wrapped around our heads. We left with our hands up, I told them not to shoot that we are Israeli. They told us to lie on the floor and questioned us, checking that we were Israelis, I told him our names and that we were wounded. At the end a helicopter came to rescue some wounded soldiers, I grabbed the soldier by the hands and looked him in the eyes, I told him "My brother I have a little girl at home and a family, you are taking me with you in that helicopter". He looked and me and told me "yalla" (come on), "cooperate". So we started to cooperate, lifting injured soldiers on my shoulders, Lior helped lifting the stretcher to the helicopter, trying to save people as much as possible, People were screaming to hold on tight, and don't die in my hands, it was like a movie. He took us at the end, Thank god now we are recovering."
ืชืžืœื•ืœ ืฉืœ ืื™ืจื•ืขื™ ืžืกื™ื‘ืช ื”ื˜ื‘ืข ืžืคื™ ืื—ื“ ื”ืฉื•ืจื“ื™ื: "ื ืกืขื ื• ื‘ืฉื˜ื— ืœื›ื™ื•ื•ืŸ ื”ื›ื‘ื™ืฉ, ืื™ืš ืฉืื ื—ื ื• ืขื•ืœื™ื ืœื›ื‘ื™ืฉ ืขืœื™ื ื• ืขืœ ืฆื™ืจ ืžืจื›ื–ื™ ืฆื™ืจ ืจืืฉื™ ืžืคื•ืฆืฅ ืžื›ื•ื ื™ื•ืช ื‘ืคืงืง ืฉื‘ืงืฆื” ืฉืœื• ืขื•ืžื“ื™ื ื›ื‘ื™ื›ื•ืœ ืฉื•ื˜ืจื™ื ื•ื—ื™ื™ืœื™ื ืฉื›ืื™ืœื• ืขืฉื• ืžื—ืกื•ื. ืขื›ืฉื™ื• ื–ื” ืœื ื”ื™ื” ืžื—ืกื•ื ืฉืœ ืžืฉื˜ืจื” ืืœื• ื”ื™ื• ืžืชื—ื–ื™ื, ืžื—ื‘ืœื™ื. ื”ื ื—ื™ื›ื• ืฉื”ื™ื• ื”ืจื‘ื” ืื ืฉื™ื ื‘ืคืงืง ื•ื”ื•ืฆื™ืื• ืžื’ ื•ื”ืชื—ื™ืœื• ืœืจืกืก ืืช ื›ืœ ื”ืžื›ื•ื ื™ื•ืช, ืœืคื—ื•ืช 300 ื”ืจื•ื’ื™ื. 300 ืื ืฉื™ื ื’ืžื•ืจื™ื, ืžื” ืฉืื•ืžืจื™ื ื‘ื—ื“ืฉื•ืช ื–ื” ื—ืจื˜ื. ืื ื—ื ื• ื”ื™ื ื• ืื—ืจื•ื ื™ื, ื ืกืขื ื• ืจื•ื•ืจืก. ืื›ืœื ื• ืฉื ื™ ื›ื“ื•ืจื™ื ื‘ืชื•ืš ื”ืฉืžืฉื”, ื›ื“ื•ืจ ื ื›ื ืก ืœืœื™ืื•ืจ ื‘ื›ืชืฃ ื•ืื ื™ ื ืคืฆืขืชื™ ืžื–ื›ื•ื›ื™ื•ืช ื‘ื™ื“ื™ื™ื. ื‘ืจื—ื ื• ืžืฉืžื ื›ืฉื”ืื•ื˜ื• ื‘ืงื•ืฉื™ ืขื•ื‘ื“, ืคืชื—ื ื• ืืช ื”ื•ื•ื™ื– ื•ืœื™ืื•ืจ ืืžืจ ืœื™ "ืฉื™ืจืชืชื™ ืคื”, ื‘ื•ื ื ืกืข ืœื‘ืกื™ืก ืฆื‘ืื™: ืื•ื’ื“ื”." ื ื•ืกืขื™ื ืœื›ื™ื•ื•ืŸ ืื•ื’ื“ื”, ื”ื™ื ื• ื‘ื˜ื•ื—ื™ื ืฉืฉื ื ื”ื™ื” ื‘ื˜ื•ื—ื™ื. ื”ื ื›ื‘ืจ ื‘ืœื™ืœื” ืคืฉื˜ื• ืขืœ ื”ื‘ืกื™ืก ื”ื–ื” ืจืฆื—ื• ื‘ืžื™ื˜ื•ืช ืฉืœื”ื ืืช ื›ืœ ื”ื—ื™ื™ืœื™ื ืฉื”ื™ื• ื‘ื‘ืกื™ืก, ื™ืขื ื• ื›ื‘ืจ ื”ืฉืชืœื˜ื• ืขืœ ื”ื‘ืกื™ืก. ืื ื—ื ื• ืžื’ื™ืขื™ื ืœืฉ"ื’ ืขื ื”ืื•ื˜ื•, ื›ื•ืœื• ืฉื‘ื•ืจ, ืจื•ืื™ื ืื—ื™ ื‘ื›ื ื™ืกื” ืฉืœ ื”ืฉ"ื’ ื”ื™ื™ืชื™ ื‘ื˜ื•ื— ืฉื–ื” ื—ื™ื™ืœื™ื ืขื•ืžื“ื™ื ืฉื 13 ืžื—ื‘ืœื™ื ื‘ืžืฆื‘ ื›ืจื™ืขื” ืขื ืงืœืืฆ'ื ื™ืงื•ื‘ ื•M16 ืžืกืชื›ืœื™ื ืขืœื™ื ื• ืžื˜ื•ื•ื— ืฉืœ ืื™ื–ื” 20 ืžื˜ืจ, ืžืจืกืกื™ื ืืช ื”ืืž-ืืžื ืฉืœ ื”ืื•ื˜ื• ืฉืœื ื•. ื™ื•ืจื™ื ืขืœื™ื ื• ืขืœ ื›ืœ ื”ื“ืœืช, ืคื’ืข ืœื™ ื›ื“ื•ืจ ื‘ืจืืฉ, ืงืจืข ืœื™ ืืช ื›ืœ ื”ืจืืฉ. ืื‘ื™ืชืจ ื’ื ืื•ืชื• ื“ื‘ืจ, ืื›ืœ ื›ื“ื•ืจ ื‘ืื’ืŸ, ืœื™ืื•ืจ ื‘ื›ืชืฃ. ื›ื•ืœื ื• ื“ื, ื–ืจืงื• ืืœื™ื ื• ืจื™ืžื•ืŸ, ืคืชืื•ื ืœื ืฉืžืขืชื™ ื›ืœื•ื, ืžืกืชื›ืœ ื™ืžื™ื ื”, ืฉืžืืœื” ืฆื•ืขืง, ืœื™ืื•ืจ ืฆื ื”ื—ื•ืฆื”, ืชื•ืคืก ืืช ืœื™ืื•ืจ, ื™ื•ืฆืื™ื ืžื”ืื•ื˜ื•, ืžืชื—ื™ืœื™ื ืœืจื•ืฅ, ื™ื•ืจื™ื ืขืœื™ื ื•, ืื ื™ ืฉื•ืžืข ืืช ื”ื›ื“ื•ืจื™ื ืขื•ื‘ืจื™ื ืœื™ ืœื™ื“ ื”ืจืืฉ, ื™ื•ืจื™ื ืœื™ ื‘ืจื’ืœื™ื™ื, ื™ืฉ ืœื™ ืจืกื™ืกื™ื ื‘ืจื’ืœื™ื™ื ืฉืœ ื”ื›ื“ื•ืจื™ื. ืจืฆื ื•, ืจื•ืื™ื ื’ื“ืจ ืฉืœ ื”ื‘ืกื™ืก, ืฉืœื•ืฉ ืžื˜ืจ ื‘ืขืจืš, ืงืคืฆื ื•, ื’ื“ืจ ืชื™ืœ, ื ื—ืชืš ืœื™ ื›ืœ ื”ื™ื“ื™ื™ื. ืงืคืฆื ื•, ื”ืชื—ืœื ื• ืœืจืื•ืช, ืžืžืฉื™ื›ื™ื ืœื™ืจื•ืช ื‘ื ื•, ืœื ืคื•ื’ืขื™ื ื‘ื ื• ื›ื“ื•ืจ, ืœื ื”ืฆืœื™ื—ื• ืœืคื’ื•ืข ื‘ื ื•. ืจืฆื™ื, ื”ืชื—ื‘ืื ื• ืฉื ืื—ืจ ื›ืš ื‘ื‘ื•ื ืงืจ ืฉืœ ื”ืฆืœืคื™ื. ื”ื™ื™ื ื• ืฉื ืื™ื–ื” 3-4 ืฉืขื•ืช, ื‘ืœื™ ืžื™ื, ืžื“ืžืžื™ื, ืขืฉื™ืชื™ ืœืขืฆืžื™ ื—ื•ืกื ืขื•ืจืงื™ื, ืœื™ืื•ืจ ืฉื ื—ื•ืกื ืขื•ืจืงื™ื. ื”ื™ื™ื ื• ื‘ื˜ื•ื—ื™ื ืฉื”ืฉืืจ ื›ื‘ืจ ืžืชื™ื ืžืื—ื•ืจื”, ืœื ื”ืกืชื›ืœืชื™ ืื—ื•ืจื”. ืื—ืจ ื›ืš ื”ื’ื™ืขื• ืฆื•ื•ืช ืฉืœ ืฉื™ื™ื˜ืช 13 ืœืชื•ืš ื”ื‘ืกื™ืก, ืžืžืฉ ืžืœื—ืžื” ื‘ืคื ื™ื, ื”ืœื›ื• ืœื”ื ืฉื ื’ื ืื™ื–ื” 30-40 ื—ื™ื™ืœื™ื. ืื ื™ ืฉื•ืžืข ืืช ื”ืฆืจื—ื•ืช ืฉืœ ืžื•ื•ืช, ื—ืœืฅ ืื—ื•ืจื”, ื—ืœืฅ ืื—ื•ืจื”, ืžืชื™ื, ื™ื•ืจื™ื RPG ืื—ื“ ืขืœ ื”ืฉื ื™, ืžืžืฉ ื‘ืชื•ืš ืžืœื—ืžื” ืื ื™ ื ืžืฆื. ืื—ืจ ื›ืš ื™ืฆืื ื• ื‘ืกื•ืฃ ืืœื™ื”ื, ืคื—ื“ื ื• ืฉื™ืจื• ืขืœื™ื ื• ื”ื—ื™ื™ืœื™ื ืฉืœื ื•, ื›ื™ ืื ื—ื ื• ื ืจืื™ื ื›ืžื• ืžื—ื‘ืœื™ื, ืขื ื—ื•ืœืฆื•ืช ืขื˜ื•ืคื™ื ืขืœ ื”ืจืืฉ. ื™ืฆืื ื• ืขื ื”ื™ื“ื™ื™ื ืœืžืขืœื”, ื”ืชื—ืœื ื• ืœืจื•ืฅ, ืืžืจืชื™ ืœื”ื ืœื ืœืจืื•ืช, ืื ื—ื ื• ื™ื”ื•ื“ื™ื ื™ืฉืจืืœื™ื. ืืžืจื• ืœื ื• ืœืฉื›ื‘ ืขืœ ื”ืจืฆืคื” ื•ื‘ื“ืงื• ืฉืื ื—ื ื• ื™ืฉืจืืœื™ื, ืืžืจืชื™ ืœื• ืืช ื”ืฉืžื•ืช ืฉืœื ื• ื•ืฉืื ื—ื ื• ืคืฆื•ืขื™ื, ื‘ืกื•ืฃ ื‘ื ื”ืœื™ืงื•ืคื˜ืจ, ืœื—ืœืฅ ืžืฉื ื›ืžื” ื—ื™ื™ืœื™ื ืฉื”ื™ื• ืคืฆื•ืขื™ื, ืชืคืกืชื™ ื”ื—ื™ื™ืœ ื‘ื™ื“ื™ื™ื ื”ืกืชื›ืœืชื™ ืœื• ื‘ืขื™ื ื™ื™ื, ืืžืจืชื™ ืœื• ืื— ืฉืœื™ ื™ืฉ ืœื™ ื™ืœื“ื” ื‘ื‘ื™ืช ื•ืžืฉืคื—ื” ืืชื” ืœื•ืงื— ืื•ืชื™ ืื™ืชืš ื‘ืžืกื•ืง. ืื•ืžืจ ืœื™ ื™ืืœืœื” ื‘ื•ืื•, ืฉืชืคื• ืคืขื•ืœื”, ื”ืชื—ืœืชื™ ืœืฉืชืฃ ืคืขื•ืœื”, ืžืจื™ื ื—ื™ื™ืœ ืขืœ ื”ื›ืชืฃ, ืœื™ืื•ืจ ืœื•ืงื— ืืช ื–ื” ื‘ืขืœื•ื ืงื” ื ื›ืกื™ื ืื™ืชื• ืœื”ืœื™ืงื•ืคื˜ืจ, ืžื ืกื™ื ืœื”ืฆื™ืœ ืืช ื”ืื ืฉื™ื ื›ืžื” ืฉืืคืฉืจ, ืชื—ื–ื™ืง ื—ื–ืง, ืืœ ืชืžื•ืช ืœื™ ื‘ื™ื“ื™ื™ื, ื–ื” ื”ื™ื” ืžืžืฉ ื›ืžื• ืกืจื˜. ืœืงื— ืื•ืชื ื• ื‘ืกื•ืฃ, ื‘ืจื•ืš ื”ืฉื ืขื›ืฉื™ื• ืื ื—ื ื• ืžืชืื•ืฉืฉื™ื."
151
1,679
232
5,779
3,828,197
Chong W. retweeted
Our product @sentioxyz is finally launched๐Ÿš€๐Ÿš€๐Ÿš€. You can check it out at sentio.xyz. I am extremely grateful for the invaluable support from @ai @ravi_lsvp @tnachen @letsgoustc @marcbhargava @shumochu @ping_wu @li_mike_yue @gokulr
4
9
6
30
5,021
I saw a sedan going 80+ MPH on 520 this morning. With temps below freezing and ice on the roads, that's just not smart. Don't be that person.
3
3
36
It looks like scenes from a horror movie. But it is not! This is the result of the murders of hundreds of civilians by Russian soldiers in Ukraine, in the town of #Bucha near #Kyiv. PUTIN NEEDS TO BE STOPPED NOW!
753
5,336
702
17,198
Officers are searching for a burg suspect in 200 blk West LK Samm Pkwy NE. Suspect has a handgun and rifle. White male, red hair & beard, 30s, wearing a hoodie. Please call 911 if you see anything suspicious.
18
44
7
110
Retweet if youโ€™re ready to end this and vote for Joe Biden.
2,950
69,954
2,249
155,186
Chong W. retweeted
Check our ACL 2020 paper on Adaptive Knowledge Sharing across Multiple Domains in Neural Machine Translation: arxiv.org/abs/1911.02692 The key is the word-level and layer-wise domain mixing layer! Joint work by @GeorgiaTechISyE and @BytedanceTalk @jiang_haoming @Ashleylololol