AICB: A benchmark for evaluating the communication subsystem of LLM training clusters by Xinyue Li, Heyang Zhou, Qingxu Li, Sen Zhang, Gang Lu

Subjects: Get full text

AsymGroup: Asymmetric Grouping and Communication Optimization for 2D Tensor Parallelism in LLM Inference by Ki Tae Kim, Seok-Ju Im, Eui-Young Chung

Subjects: Get full text

Challenges and development trends of collective communication libraries in intelligent computing scenarios by GAO Xiang, DONG Bin, XIAO Qing, JIAN Cheng, FU Deji

Subjects: Get full text

Research on multi-heterogeneous hybrid training system for AI computing power scenarios by LI Panpan, NIU Hongweihua, ZHAO Wanlong, MA Huawei, WANG Yanhui, JIANG Wei, ZHANG Wenxin, LU Yiming, ZHAO Feng

Subjects: Get full text

Novel Research on a Finite-Difference Time-Domain Acceleration Algorithm Based on Distributed Cluster Graphic Process Units by Xinbo He, Shenggang Mu, Xudong Han, Bing Wei

Subjects: Get full text

The Collective Communications in the ‘Wild Globalization’ by Silvio M. Brondoni

Subjects: Get full text