The MT-NLP has 530 billion parameters with the capability of a wide set of natural language tasks. According to the two companies, it also has comprehension, reasoning and natural language capabilities. First breakthrough The two companies have in the past worked on several innovations but this is considered the most powerful. The quality obtained is a significant step towards the journey of unlocking AI in natural language. The two innovations DeepSpeed and Megatron-LM will be the major beneficiaries of the AI model development and open the pathway for large AI models to be affordable and faster to train. Training — Jack Clark (@jackclarkSF) October 11, 2021 The training took place across 560 Nvidia DGX A100 servers, with 8 Nvidia A100 80GB GPUs for each. Although the MT-NLP has the capability of inferring basic mathematical operations, it is not entirely accurate. It however surpasses memorization and can complete tasks. Such models are crucial in amplifying the biases present in data in which they are trained. Although Microsoft acknowledges there have been challenges, they are committed to addressing them by making continuous milestones through continued research while minimizing potential harm to users. For now, users can enjoy the milestones made as we wait to see what is next in store. What are your thoughts on the collaboration between Microsoft and NVIDIA? DO you have any expectations? Let us know in the comment section below.
Name *
Email *
Commenting as . Not you?
Save information for future comments
Comment
Δ
