Fully connected neural networks in the infinite-width limit often outperform finite-width models, while convolutional networks excel at finite widths. Here, the authors uncover how convolutional ...