Finite-step statistical mechanics of scale-invariant learning:...
Stationary learning admits an ideal-gas description under restrictive noise assumptions. In neural networks whose gradient noise departs from these assumptions, however, an entropy-scaling...
arxiv.org
