Scaling laws have become a central part of how we think about scaling LLMs, but it’s not always easy to build intuition for why they work. I made a tutorial on: - scaling laws in practice: classic papers and recent developments - an intuitive associative memory toy model, where scaling can be predicted from simple intuitions - a hands-on environment for learning how to use scaling laws I gave this tutorial at MLSS Tübingen last week, and thought the material was in a good enough shape to share! x nicolaszucchet.github.io/Tut…