A Codesign of Scheduling and Parallelization for Large Model Training in Heterogeneous Clusters

Authors

Chunyu Xue, Weihao Cui, Han Zhao, Quan Chen, Shulai Zhang, Pengyu Yang, Jing Yang, Shaobo Li, Minyi Guo.

Published

24 March 2024

Publication details

Working paper

Links