Do Wide and Deep Networks Learn the Same Things?

https://ai.googleblog.com/2021/05/do-wide-and-deep-networks-learn-same.html

Google AI Blog: Do Wide and Deep Networks Learn the Same Things?
Posted by Thao Nguyen, AI Resident, Google Research. A common practice to improve a neural network’s performance and tailor it to available computational resources is to adjust the architecture depth and width.Indeed, popular families of neural networks, including EfficientNet, ResNet and Transformers, consist of a set of architectures of flexible depths and widths.
ai.googleblog.com