AICB: A benchmark for evaluating the communication subsystem of LLM training clusters

AICB: A benchmark for evaluating the communication subsystem of LLM training clusters

AICB (Artificial Intelligence Communication Benchmark) is a benchmark for evaluating the communication subsystem of GPU clusters, which includes representative workloads in the fields of Large Language Model (LLM) training. Guided by the theories and methodologies of Evaluatology, we simplified the...

Full description

Saved in:
Bibliographic Details
Main Authors: Xinyue Li, Heyang Zhou, Qingxu Li, Sen Zhang, Gang Lu
Format: Article
Language:English
Published: KeAi Communications Co. Ltd. 2025-03-01
Series:BenchCouncil Transactions on Benchmarks, Standards and Evaluations
Subjects:
LLM training cluster
Benchmark
Collective communication
Distribuited training
Online Access:http://www.sciencedirect.com/science/article/pii/S2772485925000250
Tags: Add Tag
No Tags, Be the first to tag this record!

Similar Items

Similar Items