Challenges and suggestions for development of intelligent computing in China
GUO Liang1, LIU Rui2
1. Cloud Computing & Big Data Research Institute, China Academy of Information and Communications Technology, Beijing 100191, China 2. International Cooperation Department of China Academy of Information and Communications Technology, Beijing 100191, China
GUO Liang, LIU Rui. Challenges and suggestions for development of intelligent computing in China[J]. Information and Communications Technology and Policy, 2024, 50(11): 85-89.
JIANG Z H, LIN H B, ZHONG Y M, et al. MegaScale: scaling large language model training to more than 10 000 GPUs[J]. arXiv Preprint. arXiv:2402.15627, 2024.
DONG J B, WANG S C, FENG F, et al. ACCL: architecting highlyscalable distributed training systems with highly efficient collective communication library[J]. IEEE Micro, 2021, 41(5):85-92. DOI: 10.1109/MM.2021.3091475.