Associate Prof. of Statistics & Machine Learning National University of Singapore (NUS)

Singapore
Joined April 2009
One of the final projects for my #optimization class is to investigate whether one can make progress on the square packing problem! I let a GPU go brrr overnight and it found back 6 times the best currently known N=17 packing.. The last row are packings that are about 0.05% worse
I'm sure you always wanted to know how the tightest (known) packing of "n" squares within a larger square looks like... 😍
4
3
1
17
6,873
!
Wife told me these wouldn’t fit. Little did she know I had trained for this moment for years.
1
294
Mean-Field Potts model: 1st order phase transition
1
8
396
For a higher number of vertices:
2
167
Lots of fun learning how to use @claudeai code, it took ~100 steps & several agents to build a human-like solution to that (very difficult) sudoku. Anybody managed to do that for chess tactics?
1
1
9
730
Start-of-the-semester survey to a ML class: non AI-assisted coding is dead 👍
1
4
502
🔥 WANTED: Student Researcher to join me,@ValentinDeBort1,@thjashin,@liwenliang,@ArthurGretton in DeepMind London. You'll be working on Multimodal Diffusions for science. Apply here google.com/about/careers/app…
9
47
8
322
85,363
I'm teaching Bayesian Optimization for the first time this semester, so finally had to implement it myself. Fun stuff, with a few gotchas along the way!
2
16
761
Art B. Owen. [math.ST]. Better bootstrap t confidence intervals for the mean. arxiv.org/abs/2508.10083
2
11
767
Alex Thiery retweeted
I'm looking for talented and ambitious PhD students to join me at Nanyang Technological University Singapore to work on safe and robust AI systems! Full scholarships covering tuition and a stipend are available, and are open to local and international students alike.
5
18
1
78
7,979
Scalable Monte Carlo for Bayesian Learning by Professor Paul Fearnhead, Dr Christopher Nemeth, Professor Chris J. Oates and Dr Chris Sherlock A clear and intuitive introduction to advanced topics in Markov chain Monte Carlo, with a focus on scalability. 📚 cup.org/4l42JW8
1
4
11
984
Why do we keep sampling from the same distribution the model was trained on? We rethink this old paradigm by introducing Feynman-Kac Correctors (FKCs) – a flexible framework for controlling the distribution of samples at inference time in diffusion models! Without re-training or fine-tuning (just with the raw power of math), we demonstrate how to sample from: 1. product of densities (e.g. for conditioning generations on several things) 2. annealed density (invaluable property for diffusion-based samplers) 3. geometric-average of densities (to bridge the gap between classifier-free guidance and the common intuition) 4. reward-tilted density (easy to get within our framework, but we focus on other cases that don't require an external reward function) @martoskreto prepared beautiful animations for you in the thread below, or you can go directly to check - Paper: arxiv.org/abs/2503.02819 - Code: github.com/martaskrt/fkc-dif… - Educational example: colab.research.google.com/dr…
🧵(1/6) Delighted to share our @icmlconf 2025 spotlight paper: the Feynman-Kac Correctors (FKCs) in Diffusion Picture this: it’s inference time and we want to generate new samples from our diffusion model. But we don’t want to just copy the training data – we may want to sample from an annealed distribution (e.g. to find modes), or combine two experts by sampling from the product of conditional densities (e.g. to design molecules that bind to two protein pockets). FKCs let us do this!✨But how? We explain in the 🧵 below. (work with an amazing amazing team -- @tara_aksa @OhanesianViktor Roberto Bondesan @A_Aspuru_Guzik @ArnaudDoucet1 @brekelmaniac @AlexanderTong7 and @k_neklyudov) 📃arxiv.org/abs/2503.02819 🧑‍💻github.com/martaskrt/fkc-dif…
1
27
2
137
31,233
Lecture notes: "Data-driven approaches to inverse problems" (by Carola-Bibiane Schönlieb, Zakhar Shumaylov): arxiv.org/abs/2506.11732 [Comments:Notes from Machine Learning: From Data to Mathematical Understanding (CIME 2023)]
2
32
148
7,435
Geodesic path v.s. KL(pi, target) gradient flow under the Fisher-Rao Metric: can you tell which is which?
6
5
44
3,351
One #postdoc position is still available at the National University of Singapore @NUSingapore to work on sampling, high-dimensional data-assimilation, and diffusion/flow models. Applications are open until the end of January. Details: alexxthiery.github.io/jobs/2…
6
1
37
4,618
Variational approximation with Gaussian mixtures is looking cute! So here it's just gradient descent on K(q||p) for optimising the mixtures means & covariances & weights...
Gaussian approximation of a target distribution: mean-field versus full-covariance! Below shows a simple gradient descent on KL(q||p)
3
20
2
189
26,819
Gaussian approximation of a target distribution: mean-field versus full-covariance! Below shows a simple gradient descent on KL(q||p)
1
5
1
57
32,619