Beyond scaling curves: internal dynamics of neural networks through the NTK lens

Today's article comes from the journal of Machine Learning Science & Technology. The authors are Nikolaou et al., from the University of Stuttgart, in Germany. In this paper they use NTK (the Neural Tangent Kernel) as a lens to study what actually happens inside neural networks as we scale them up.