https://ai.googleblog.com/2021/05/do-wide-and-deep-networks-learn-same.html
 |
Google AI Blog: Do Wide and Deep Networks Learn the Same Things? Posted by Thao Nguyen, AI Resident, Google Research. A common practice to improve a neural network’s performance and tailor it to available computational resources is to adjust the architecture depth and width.Indeed, popular families of neural networks, including EfficientNet, ResNet and Transformers, consist of a set of architectures of flexible depths and widths. ai.googleblog.com |