Microsoft’s Singularity is a response to the computational costs of training deep learning workloads—costs that have quickly spiraled as those workloads have grown in size, complexity and number. It is also an attempt to maximize the use of idle time, which has increasingly become a focus of discussions of how to minimize the costs and environmental footprints of high-performance computing systems and AI model training on such systems.
The post Microsoft’s ‘Singularity’ to Enable Global Accelerator Network for AI Training appeared first on HPCwire.
