Research Scientist at Google DeepMind, working on Gemini. (prev. PhD at ETH Zürich & MPI-IS Tübingen.) No second-hand opinions. They are absolutely my own ;)
New York
Joined October 2022
- Tweets51
- Following110
- Followers484
- Likes71
Sidak Pal Singh retweeted
✨New Preprint ✨ Ever thought that reconstructing masked pixels for image representation learning seems sub-optimal?
In our new preprint, we show how masking principal components—rather than raw pixel patches— improves Masked Image Modelling (MIM).
Find out more below 🧵
Sidak Pal Singh retweeted
Don’t miss our poster shedding more light on sharpness regularization at NeurIPS tomorrow neurips.cc/virtual/2024/post…
Sidak Pal Singh retweeted
Tuesday 1:30pm-3pm, Hall C 4-9 #515.
Drop by our poster if you are interested in SSMs for graphs👇!
Code: github.com/skeletondyh/GRED
Sidak Pal Singh retweeted
We are delighted to announce our next speaker for the @ELLISforEurope Maths for DL RG is @MihaelaCRosca fr @GoogleDeepMind presenting arxiv.org/pdf/2302.01952.pdf
on 30th May over Zoom. Joining Link - ellis.eu/reading-groups. Thanks to @unregularized & @LinaraAdylova for co-chairing!
Sidak Pal Singh retweeted
🚨@FCHEN_AI, @atsushi_y1230, and I will be presenting our NeurIPS2023 paper arxiv.org/abs/2306.04251 to ELLIS Mathematics of Deep Learning reading group tomorrow Feb 13 at 5pm CET. Join to learn more about stochastic collapse!
Sidak Pal Singh retweeted
We are delighted to announce our next speakers for the @ELLISforEurope RG are fr @Stanford, the authors of the NeurIPS2023 paper (arxiv.org/abs/2306.04251)-@FCHEN_AI @KuninDaniel @atsushi_y1230 & @SuryaGanguli on 13th Feb '24 @ 5pm CET on Zoom. Save the Date! Link to join the RG👇
I am delighted to be a chair for an @ELLISforEurope Reading Group on Mathematics of Deep Learning along with @LinaraAdylova and Sidak @unregularized. The link to join the group is here - bit.ly/3fjh8la, looking forward to meeting new people! @CompSciOxford @oxengsci
