A small convolutional network beats a plain flatten-and-feed-it-forward network by 7. 0 points on CIFAR-10. That's convolutions, pooling, normalisation and skip connections doing honest work.
Source: [Dev.to](https://dev.to/pytorchfromgroundup/your-cnns-advantage-is-one-assumption-and-i-measured-what-happens-when-it-breaks-490d)