UC Irvine Today
CS Seminar Series: DNN Training Acceleration through Better Communication-Computation Overlap: Sangeetha Abdu Jyothi
The Computer Science Seminar Series is proud to present Sangeetha Abdu Jyothi (UC Irvine). As deep learning continues to revolutionize a variety of domains, training of Deep Neural Networks (DNNs) is emerging as a prominent workload in data centers. Data parallel DNN training is commonly employed for scalability. However, the relationship between communication and computation, a key factor that affects the DNN training throughput, is often overlooked in this network- and compute-intensive workload. This talk will cast light on the communication-computation interdependencies that are critical for DNN training acceleration, and present two systems that significantly improve the training performance by leveraging this understanding.
Friday, October 16 at 11:00am to 12:00pmVirtual Event