硅谷101泓君Jane

Can we coexist with an intelligence far more powerful than us? And if so, how? At Alignment 2026, @Valley101en's annual summit in Sunnyvale, our CEO @KolentoH moderated the opening panel, “Alignment Under Pressure: Can We Develop Superintelligence Safely?” with: John Yan (Founder of Gutenberg, ex-@AnthropicAI) Bo Li (Professor at @UofIllinois and Co-founder & CEO of @VirtueAI_co) Long Phan (@CAIS) Five insights from the discussion: Higher safety scores don’t necessarily mean lower risk: Long Phan’s Safetywashing research highlights how improvements can reflect greater general capability without demonstrating that a model is safer. Understanding model behavior requires looking beyond its own explanations: John Yan highlighted interpretability as a way to investigate what a model is doing without relying on it to truthfully explain itself. Following an instruction can still miss the user’s intent: Bo Li described how an agent asked to clean up a code branch might delete the main branch. Safety at scale faces a latency bottleneck: Bo pointed out that safeguards need to check agents before they act, but those checks add delays. For the next generation of researchers, Bo offered a practical starting point: understand AI-generated work and build checks for AI and agentic systems, much like software unit tests, to verify what those systems are doing. Thank you to @hongjun60, @Valley101_Qian, @itsyiwenlu and the Valley101 team for having us, and to everyone who joined the conversation.