
When it comes to how fast artificial intelligence (AI) models can continue to grow, the sky is not the limit; system design is. As researchers continue to push boundaries with conversational AI, computer vision, recommender systems, and other workloads, AI models advancing toward hundreds of trillions of parameters may soon be commonplace.
The post How Giant AI Workloads and the Looming “Bandwidth Wall” are Impacting System Architectures appeared first on HPCwire.