GPT-3 is part of a new class of models, which Microsoft is broadly exploring through its AI at Scale initiative, that learn from examining billions of pages of publicly available text. They so deeply absorb nuances of language, grammar, knowledge concepts and context that the same model is able to perform a broad set of tasks that involve generating text.