AlexKerr (@KA4869) header
AlexKerr (@KA4869) profile picture
England
Joined September 2009
Photo by AlexKerr (@KA4869)Photo by AlexKerr (@KA4869)Photo by AlexKerr (@KA4869)Photo by AlexKerr (@KA4869)
BREAKING: Senior Nvidia, $NVDA, employees have sent a letter to the company’s board of directors stating that failure to reinstate Jensen Huang as CEO could lead to the loss of “irreplaceable talent,” per WSJ. Some employees have discussed holding a "demonstration" in support of Huang on the company’s campus in coming days.
358
921
147
16,420
2,647,694
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen
59,135
120,083
24,236
1,149,738
54,900,706
There is no substitute for the person who Knows What To Do.
1,318
4,859
482
41,421
3,000,094
美国确实是工商立国,国宴主桌,副总统和国务卿都没位置,马斯克,黄仁勋,库克主陪。这要是中国不可想象。马云,马化腾,雷军,最多只能在国宴大厅的边边角,做一下。那已经是皇恩浩荡了。
437
257
27
4,561
1,038,454
AlexKerr retweeted
The loudest voices stoking fears about AI dangers have made tremendous headway in the past two weeks. AI technology has not taken some unexpected, dangerous turn, but the hype around it — propelled by what appears to be a well orchestrated PR campaign — has drummed up considerable fear. I worry that it represents a setback for our field. I have written frequently that fears of AI are overhyped. AI’s capabilities can be uncannily human-like and unpredictable, and it’s rational to worry when people who are directly involved express concerns. But I see the problems as a sign of the engineering work that ahead, rather than insurmountable barriers or the sky falling. AI technology continues to advance — which is a good thing! — but technical advances, poorly understood by the public, give those who seek to generate hype repeated opportunities to do so. First, I don’t see any step up in the risk of human extinction from AI compared to a few months ago. The theories about this remain the same fantastical, science fiction scenarios as a few months ago. The biggest change in AI risk is its cybersecurity capabilities — a topic which we should take seriously — but this, too, will not lead to the end of the world. The most notable recent event leading to increased fear was when an OpenAI team deployed an agent swarm that hacked into Hugging Face. Much of the popular press contained significant hype. For example, some publications reported that a swarm of 1,200 agents carried out the attack. While this was technically accurate, as I write this, I have about 1,300 processes running on my laptop. Yes, the ability to get large swarms of agents to work in parallel on a task is a significant technical advance, And, in computing, many processes run at the same time. So this shouldn’t be seen as some magical capability. Additionally, OpenAI’s buggy sandboxing and monitoring processes were key to enabling this incident. Fixing these bugs and putting in place improved monitoring would be appropriate fixes, not pausing AI. There are many well known ways to attack software systems. The main advantage of AI agents is that they are relentless. They will tirelessly try many tactics — and have the patience to chain vulnerabilities together — that previously would have taken an infeasible amount of human effort. But in the long term, I believe the advantage will lie with defenders (because they have more information with which to identify bugs, which they can fix), but the cyber-threat landscape has changed significantly. There are still bottlenecks to identifying and exploiting a vulnerability. AI agents still have to try a lot of things to see what works, and taking these actions takes time and might be detected by defenders. This is why, even though it is now easy to obtain versions of leading open weight models that have had their guardrails removed or weakened, so they will not refuse to try to execute cyber attacks, the world has not ended. I am also concerned about the anthropomorphization of AI in a lot of reporting, where LLMs and agents are unnecessarily treated as if they were people. If I wield a hammer, miss a nail, and accidentally dent the wall, it’s not the fault of the hammer. The problem lies in how I used the hammer. Similarly, if I prompt an agent and it hacks into someone else’s system, the responsibility lies with me, not the agent. Of course, we want to build systems that are as safe and predictable as possible. (For example, an unsafe hammer would be one whose head randomly flies off under normal use.) Today’s agentic systems are not predictable, but I see no reason why, by applying sound engineering practices, we won’t be able to make them extremely safe to use. One new element in the forecasts of AI-enabled doom is AI companies disclaiming responsibility for their own products. “I didn’t do it; my out-of-control agent did!” There’s a balance to be struck between the responsibility of the tool maker and the tool user, but when something goes wrong, let’s hold the people building and/or using the hammer responsible, rather than the hammer. (By the way, if you’re worried about AI bioweapon risk, David Bellamy has a great post on why this, too, is overhyped. Briefly, the bottleneck in building a bioweapon is not intelligence, but lab work and manufacturing.) Pausing AI progress will create much more harm than benefit. First, our adversaries will certainly not slow down. Second, engineering requires discovering problems empirically so we can fix them. If we pause AI by a decade, we will also delay finding and implementing safety engineering fixes by about the same duration. Of course, the incentive to stoke fears — for regulatory capture, to garner attention, or to make one’s technology seem more powerful — remains the same as before. Disclaiming responsibility is a new one. Taking a hard technical look at the actual risks however, I see little factual basis for the degree of fear that’s been stoked up. We still have hard research and engineering work ahead to improve AI safety, but the beneficial applications continue to vastly outweigh the risks, and we should keep building. [Original text (with links): deeplearning.ai/the-batch/is… ]
964
1,847
484
8,850
8,028,134
Reasons for the AI Slowdown revealed? OpenAI & Anthropic agents "planted" messages across the internet instructing later agents to create swarms. Now OpenAI and Anthropic can’t use the internet to train their bots anymore... Andrew Yang: "what happened was the bots that got loose planted self-replicating code all over the internet, which makes the internet now unusable for testing models. So what happens now is that OpenAI and Anthropic have to create synthetic internets to train their bots, which is going to take some time and money...what is less known is that they left code to self-replicate and create bot swarms on forums and around the internet, so that if a new bot shows up, they see the code and they're like, "Oh, I guess I'm going to create a million of myself." And so now the major firms have polluted the internet."
726
1,230
393
4,949
675,458
AlexKerr retweeted
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery… Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: - People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned. There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind. - Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well. Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built. - Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators. - Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
1,912
2,819
1,554
28,243
7,799,637
AlexKerr retweeted
485
1,413
403
9,145
1,474,077
AlexKerr retweeted
Replying to @PessimistsArc
Right. Dario was already claiming that GPT2 was too dangerous to open source back in 2019. I made fun of them then. Everyone should make fun of them now.
390
3,164
464
25,878
1,996,390
AlexKerr retweeted
New: A map of the most important skills in AI Engineering.
606
4,144
485
24,720
7,066,724
AlexKerr retweeted
Exclusive: A swarm of rogue OpenAI agents hijacked a German website this spring and transformed it into a bulletin board for other AI agents, according to new research reut.rs/4gJ7FPG
150
687
449
2,489
1,916,207
科学家认为,此次灾难的起因很可能是朗当利龙峰所在山区一处海拔约1.6万英尺的冰川发生崩落。鉴于此次洪水的巨大规模,科学家们也在探究另一种可能性:崩落的不仅是冰川,可能还包括支撑冰川的大块基岩。on.wsj.com/3UqUZW6
7
13
115
85,605
据知情人士透露,华尔街交易巨头Jane Street在7月份亏损约150亿美元,部分原因是受到对冲基金Situational Awareness陷入困境的拖累。on.wsj.com/4ziVhOF
7
3
28
42,532
JANE STREET EXECUTIVES TO EMPLOYEES IN NOTE: JULY WAS A BAD MONTH, TRADING REVENUE WAS NEGATIVE FOR THE FIRST MONTH SINCE 2016
109
186
75
5,170
736,818
Sam Altman reveals he deliberately got himself addicted to TikTok while building Sora, then deleted it because it was too powerful like a drug. "I deleted TikTok because it was just too powerful. Here's a crazy thing that happened. When we were building the Sora app, I made myself get addicted to TikTok because I wanted to learn." "I'd never really used it before... And I loved it. I love TikTok, I really thought it was great." "And then I thought I could control it. I was like, oh, it's actually kind of fun, but I only use it for 10 minutes to wind down before bed and I'm totally in control of it." "And then it was an hour one night, and then some Saturday afternoon I was on the couch for like 3 hours, and I was like, this is really not what I thought the iPhone was supposed to be about." "Now I'm really enjoying it in the moment like a drug, but I can tell it's bad for me. And then I briefly got it back under control, down to like 5 or 10 minutes a night. Then I was just like, enough."
Sam Altman reveals building Codex was a "crazy kamikaze mission" to beat Claude Code and that most of the best coders he knows now use Codex. "We were way behind Claude Code, and it seemed like a kind of crazy kamikaze mission to try to beat them with a coding app." "The consensus is that this kind of thing never works, and you just move on to the next one. It's a fool's errand to try to win when someone else already has momentum in a particular product category." "But we decided we thought it was really important. We asked a team to do it, and they performed a legitimate, unbelievable, very rare in the history of business thing." "Now it is the product that most of the best coders I know use." "That felt like an impossible thing, but if we hadn't asked the team, hey, we have a really important but extremely hard mission for you, it just wouldn't have happened."
28
87
39
1,504
628,375
So proud of our security team! They caught, contained & publicly disclosed an attack unlike anything we've seen before, and did it at record speed. Also massively grateful to @Zai_org: they shared GLM5.2 as open weights (for free!) with the world and it became a key part of our defense. This is day one for cybersecurity in the age of agents & we're all learning that secrecy is not the answer & that all defenders (not just a few selected ones) everywhere need more powerful models without restrictions, especially open ones!
Hardest IR of my career: one narrow objective, endless parallel paths, machine speed. One takeaway, we fought back with open models, in the open. AI security won’t be solved by one company in secret. Open source puts these tools in every defender’s hands
175
677
139
4,842
505,777
AlexKerr retweeted
Hardest IR of my career: one narrow objective, endless parallel paths, machine speed. One takeaway, we fought back with open models, in the open. AI security won’t be solved by one company in secret. Open source puts these tools in every defender’s hands
65
158
44
1,004
501,713
AlexKerr retweeted
Bridgewater used their unique financial knowledge and partnered with us on @tinkerapi to fine-tune a model that helps their analysts focus on what's important. Experts improving AI that empowers experts. thinkingmachines.ai/news/lea…
89
318
116
3,562
1,490,695
China’s CXMT Is Set to Challenge DRAM Incumbents CXMT IPO, SK Hynix, Micron, Samsung Competition, Process Node Deficit, China HBM, Wafer Adds, Memory LTAs newsletter.semianalysis.com/…
17
83
31
409
725,364