
Assoc. VP (AI) @NUSingapore, Assoc. Prof. @NUSComputing. I love to chat about the value of data & how agents interact with data.
Singapore
Joined August 2020
- Tweets539
- Following181
- Followers929
- Likes760
I was on a bus with my students to dinner yesterday. We overheard (not eavesdropped cos one of them was pretty loud 😅) a conversation between two young chaps in their 20s. Our eyebrows naturally rose when we heard this:
"I had to offload my thinking to AI."
The preceding sentences had to do with some assignment question not specifying enough details for them to know exactly how to tackle it.
What happened to asking the teaching staff?
On a more general note, if the details of a problem in the real world can be laid out precisely and exactly when you're first exposed to it, we can indeed do what the young chap has said above and obtain a reliable response from the AI model. In this regard, what then should they learn? Perhaps, we should rethink our aim of education.
Excited to be called upon again to serve as a Senior Area Chair (SAC) of #ICML2027!
The past year had been a rollercoaster ride (intense level) for @iclr_conf, @NeurIPSConf, and @icmlconf. I'm wondering how these AI conferences will be transforming themselves to accommodate the massive number of submissions and come to a steady state (if at all possible).
There is a real possibility that I won't be able to attend @NeurIPSConf #NeurIPS2026 as my students have all indicated their interests to present their papers (1 registered author per paper).
Grateful that this happened.
Bryan Kian Hsiang Low retweeted
I’ll be presenting CORAL at COLM today from 11 AM to 1 PM!
🚀 Since its release, CORAL has reached 1.1K GitHub stars and is already being used by engineers and researchers at Takeda, Jump Trading, TikTok, Tencent, Symbotic, and many others.
Recent efforts by frontier labs to tackle challenging math problems with multi-agent systems also seem to share many of the design principles behind CORAL.
If you’re interested in multi-agent evolution and AI for open-ended discovery, stop by and chat with us!
#GLOW.AI held a farewell party for Ruth Chew @ruthchewing (I'm pointing at her in the photo) who will be heading to @UW for her Ph.D. in Computer Science and Engineering with Pang Wei @PangWeiKoh.
I've known Ruth since her undergrad days back in 2018 when she did her Senior/Final Year Project on @InverseReinforcementLearning with me. During her DSO stint, she did her Master's thesis with me as well, which led to the joint work on BILBO: BILevel #BayesianOptimization (with Phong @qphong) published in @icmlconf #ICML2025 (see her video presentation at slideslive.com/39042343/bilb…). She has recently led a joint research effort (with Zhiliang @ZhiliangChen94 and Apivich @apivich_h) to develop a benchmark to democratize black-box optimization research for expensive #LLM tasks (chewwt.github.io/bolt/).
Ruth will be dearly missed!
Gregory Lau @greglau (funded by the @AISingapore - CNRS@Create DesCartes Joint PhD Scholarship) had also graduated from #GLOW.AI and recently received the Ministry of Education, Singapore (@MOEsg) Singapore Teaching and Academic Research Talent (START) Award (paired with Nanyang Technological University Singapore @NTUsg) to do an Overseas Post-Doctoral Fellowship at Massachusetts Institute of Technology @MIT. His joint work with Apivich on PINNACLE (#ActiveLearning of #PhysicsInformedNeuralNetworks) was published in @iclr_conf #ICLR2024 (spotlight presentation) and had been recognized with the Best Paper Award in the #ICML2024 Workshop on AI for Science. He is also a great teacher in my CS3264 Foundations of ML course, having received the NUS Computing Teaching Fellowship Scheme award, which is given to those with excellent performance as a tutor.
At this party, we also welcome our new member, Joseph Tze Tzun Teoh, to our #GLOW.AI family. He is a recipient of the @AISingapore Ph.D. Fellowship. Looking forward to his significant contributions in AI research!!!
In my morning jog from home, I reached the "Goldilocks zone" 😂 where this happened!
What should I do??? Just do it.
Bryan Kian Hsiang Low retweeted
🥈 Runner-up: "Nonlinear Axiomatic Attribution for Cooperative Games" — Weida Li, Zhuanghua Liu, Yaoliang Yu, Bryan Kian Hsiang Low
Congrats to Weida Li @ZhuanghuaL Yaoliang Yu for receiving the Best Paper - Runner-up Award at #UAI2026 @UncertaintyInAI for our work "Nonlinear Axiomatic Attribution for Cooperative Games"!!!
See what Weida has to say about our work below:
Since digging into the #ShapleyValue, one question has lingered in my mind: To what extent are the Shapley value and its counterparts actually useful in AI? For simplicity, we focus on the AUC metric, the area under the insertion curve, which is commonly used across scenarios to identify the combination of players with the most contributions. We treat this metric as a must-use benchmark to examine the Shapley value and its counterparts, and study how well they perform at maximizing this AUC metric.
As far as we know, the popularity of the Shapley value stems from it being the unique attribution method satisfying a certain set of axioms. However, several works have theoretically demonstrated its unreliability in different aspects. They tell the same story: The linearity axiom makes the Shapley value a linear operator with a large null space. As a result, there exist many significantly different cooperative games (also called utility/characteristic functions) that share the same Shapley value, i.e., the Shapley value can't distinguish between them. This argument also extends to the AUC metric. Since the AUC metric only concerns the ranking of assigned contributions, the efficiency axiom is unnecessary. This raises a question: What would attribution methods look like if we remove only the linearity and efficiency axioms?
The mathematical convenience that the linearity axiom provides is significant. It allows us to break down a cooperative game into a sum of easy-to-tackle simple games as the first step. Without linearity, it's a different story. Still, in our UAI2026 paper, we introduced a class of nonlinear axiomatic attribution methods through additive approximation.
Concurrently, and as something of a happy coincidence, we discovered another class of nonlinear axiomatic attribution methods in "TreeGrad-Ranker: Feature Ranking via O(L)-Time Gradients for Decision Trees", which is accepted to @iclr_conf #ICLR2026. It was derived by heuristically maximizing the AUC metric, and the resulting formula resembles the Shapley value, except that the weights now depend on the cooperative game itself. If you find our UAI2026 work interesting, this one is definitely worth a read too!
It is worth mentioning that our ICLR2026 work also led to a small contribution to the great #XGBoost library, which had just won the Test of Time Award @kdd_news #KDD2026! In our research, we wanted utility functions that are sufficiently complex while still allowing the #ShapleyValue and its counterparts to be computed exactly without approximation. That search led us to the linear TreeSHAP algorithm where we noticed a severe numerical issue and introduced a fix, TreeGrad-SHAP, which was later adopted and efficiently implemented into the #XGBoost library through the excellent work "Quadrature-TreeSHAP: Depth-Independent TreeSHAP and Shapley Interactions".
Alfred @alfredleongwl has famously commented on Aug 4, "If an AI model generated this, 💩. If a human drew it, 🙀."
Seeing that my face turned sullen, he quickly went on to explain himself that the AI model is measured by how well and realistic it can replicate the corresponding photo/image. My natural response is why not look at the photo/image directly then (something which I have taken for granted now with camera technology)?
This artwork is drawn by my child.
She had a somewhat similar concern as Alfred during primary school. She felt something amiss. She commented before that unlike her friends, her artwork did not replicate the realism that was expected of her. Instead, everything she drew has a certain "rustic" feel which I could not articulate precisely.
For example, even when drawing a book, others might additionally use a ruler to outline the book. She would simply trace it out with just a pencil; the drawn book looked as if it had been dried under the sun after being accidentally dropped into the pool.
I saw *her* in the artwork, her interpretation of the world and environment surrounding her. Would you call that her unique signature? Her style? I asked her not to change cos it defines part of who she is.
I have no doubt that such a style of hers can be replicated at scale by AI now (especially after I've uploaded it online). Should it? A question in this century to be debated.
#DataAttribution #DataProvenance
Recently, @OpenAI, @GoogleDeepMind, @ElevenLabs, and @AnthropicAI (support.claude.com/en/articl…) are all pushing #watermarking and #provenance forward.
These efforts raise an important question:
If model owners can watermark the content generated by their AI models for provenance and traceability, shouldn’t data owners be able to do likewise and know whether their personal content is used by the AI models?
In other words, alongside asking,
“Is this content generated by that AI model?”
shouldn’t we also be able to ask,
"Is that AI model trained on my personal content?”
Back in 2023 (i.e., well before data provenance for LLM training became a mainstream conversation), we were already thinking seriously about this equally important problem.
If the personal content of a data owner could be watermarked, its downstream use could be traced, including whether it was used to train an LLM.
At that time, existing text watermarking methods were not robust nor practical enough for protecting arbitrary data at scale. That motivated us to develop a text watermarking framework, Waterfall, specially designed for data owners.
Just like how watermarking can give model owners visibility into whether their generated content is being used, Waterfall can give data owners visibility into whether their personal content is being used.
Check out our post from back then: xitter.cf/bryanklow/status/18512…
Great to see @OpenAI join @ElevenLabs in adopting @Google's SynthID for audio, enabling their users to have access to the same robust, imperceptible safeguards that power our own products.
For years, we at @GoogleDeepMind have been pioneering research on SynthID watermarking to address the risks of AI-generated media (particularly acute for audio and voices).
We had successfully integrated SynthID to safeguard our product surfaces - Gemini Live, Lyria, and Veo, but protecting the ecosystem requires an industry-wide effort to build foundational safety infrastructure together which is now gaining momentum!
SynthID: deepmind.google/models/synth…
OpenAI Verification Portal: openai.com/research/verify
ElevenLabs: elevenlabs.io/blog/synthid
Homecoming for Zhongxiang Dai!!!
He is currently an Assistant Professor (Presidential Young Fellow) at The Chinese University of Hong Kong, Shenzhen @cuhksz and recently received the award of 国家级高层次青年人才.
GLOW.AI is hosting him for the months of July and August at @NUSComputing Computing!
Want to know more about how to use Multi-Armed Bandits to optimize Agentic Workflow? Check out his recent works @icmlconf #ICML2026!
#AgenticAI
Wow!!! What a pleasant surprise this morning.
AI models are incredibly powerful these days. Which one generated this?
Hmmm... a nutri-grade C on a black coffee or expresso dispensed from a machine?
@MHotelSG
I'm glad to be able to serve as a Senior Area Chair (SAC) for @iclr_conf #ICLR2025, #ICLR2026, and #ICLR2027!
Separately, Data-centric AI finally becomes mainstream in @NeurIPSConf #NeurIPS2026 and @RealAAAI #AAAI2027 as it is listed as one of the topics/keywords/areas of interest in the AI/ML community! Will #ICLR2027 do likewise?
#DataCentricAI
To love and be loved.
Thank you @AISingapore Admin Team! 😭😭😭
Ops 4ever!
Bryan Kian Hsiang Low retweeted
CORAL is heading to COLM 2026! 🪸🎉
Thrilled to share that our work, “CORAL: Towards Autonomous Multi-Agent Evolution,” has been accepted to COLM 2026!
What happens when AI agents move beyond rigid workflows and start collaborating, organizing, accumulating knowledge, and evolving together? Check out CORAL and drop us a ⭐ if you find it interesting: github.com/Human-Agent-Socie…
See you at COLM 2026—let’s grow the reef together! 🪸
📖Paper: arxiv.org/abs/2604.01658
#agentic #llms #selfevolvingagent #multiagent #autoresearch #alphaevolve #colm
We organized the 2nd NUS Computing Networking Session and Reception on 9 July in Seoul during the @icmlconf #ICML2026 week!
I like to thank our @NUSingapore Computing faculty members (Mohan Kankanhalli, Angela Yao, See-Kiong Ng, Chun Kai Ling, Warut Suksompong, Ee-Chien Chang, Diptarka Chakraborty, Anji Liu, Vikas Deep, Davin Choo (starting on Jan 2027)) for actively engaging and interacting with our invited guests to inform them about the exciting research highlights and activities, the joint collaborations with the big techs and industries, and the available faculty openings and funding opportunities.
I've shared about the 3C's (with a slight twist) of @NUSComputing:
(1) We provide the environment & resources to champion bold initiatives & tackle grand challenges. As a result, we can go beyond publications to produce research breakthroughs, societal impact & thought leadership.
(2) We nurture, mentor & cultivate the young generation to be future leaders who will decide the society of the future.
(3) We embrace the kampung spirit that is uniquely Singapore. Imagine a melting pot of diverse global talents coming together to form a community/kampung that is collegial, collaborative, and caring.
At the university level, Mohan has shared about the NUS Artificial Intelligence Institute @nusaiinstitute, bringing together faculty members of different disciplines in various colleges, faculties, schools, and departments of National University of Singapore to collaborate in AI fundamental research and AI+X.
At the national level, See-Kiong has shared about AI Singapore @AISingapore and how this national program is a synergistic effort between Academia, Government, and Industry (AGI) to boost the AI capabilities of Singapore.
What's different this time is a panel discussion moderated by Davin Choo with the panelists Chun Kai, Anji, and Angela on their journey from PhD to a faculty member.
My heartfelt thanks to Chloe Nott from National AI Group in the Ministry of Digital Development and Information @SingaporeMDDI for gracing the event, which demonstrates how our Singapore government is willing to work closely with the academia in recruiting top AI talents to Singapore. Together, we shape the future of AI for Singapore.
I would like to thank our @NUSComputing Dean, Tulika Mitra, our HoD, Seth Gilbert, and Assoc. Prof. Suranga Nanayakkara and his comms team for their strong support of this event!
Kudos to Lynn Wong and Zi-Yu Khoo @ziyuuu____ for co-organizing this event with me once again and making it a success! Their professionalism and dedication can be easily seen from the photos taken at the event, ranging from the choice of the cozy tech-oriented venue, to the careful selection of the canapés and the door gifts carried all the way from SG to the event venue with the help of #GLOW.AI group members. I could not pull this feat off without them!




























