The Open Source Technologies Behind One of the Biggest Language Models in History

https://medium.com/dataseries/the-open-source-technologies-behind-one-of-the-biggest-language-models-in-history-5757442b0bb3

The Open Source Technologies Behind One of the Biggest Language Models in History
ZeRO and DeepSpeed are powering Microsoft’s Turing-NLG which is considered one of the largest natural language models in the history of AI.
medium.com