|
 |
I am a Professor in the Department of Computer Science at the University of Hong Kong. I received my Ph.D. degree from the Department of Electrical and Computer Engineering in the University of Toronto, Canada, and both my M.Engr. and B.Engr. degrees from the Department of Computer Science and Technology in Tsinghua University, China.
Research Interest
My current research interests span cloud computing, distributed machine learning systems, distributed learning algorithms, and intelligent technologies for elderly care. My research features performance modeling and algorithm design for various network systems using optimization and machine learning methods, as well as the design and implementation of various systems based on relevant methods. Please see my research projects and publications for more details.
Contact
Email: cwu@cs.hku.hk
Phone: (852) 2857 8459
Fax: (852) 2559 8447
Office: Room 427, Chow Yei Ching Building
Mailing address:
Department of Computer Science
The University of Hong Kong
Pokfulam Road
Hong Kong
News
**[May 2024] I am looking for self-organized, well-motivated PhD students (for Fall 2025), postdoc researchers and RAs (anytime) to work on a variety of topics in distributed machine learning algorithms and systems, NLP for cognitive stimulation, and 3D modeling/streaming for virtual reality applications. Candidates with solid background and/or strong interest in mathematical modeling and analysis, and candidates with solid programming skills and/or strong interest in building systems are both very welcome. Please contact me by email with your CV (please include your GPA and rank).
**
[August 21, 2024] Guangming's paper "HybridFlow: A Flexible and Effi- cient RLHF Framework" is accepted to EuroSys 2025. Congratulations!
[May 16, 2024] Sheng's two papers are accepted to ACL 2024. Congratulations!
[Apr 13, 2024] Xiaoyang's paper "AdapCC: Making Collective Com- munication in Distributed Machine Learning Adaptive" is accepted to IEEE ICDCS 2024. Congratulations!
[Feb 24, 2024] Two papers from our group are accepted to MLSys 2024!
[Jan 16, 2023] Junwei's paper "PRES: Toward Scalable Memory-Based Dynamic Graph Neural Networks" has been accepted to ICLR 2024. Congratulations!
[Sep 12, 2023] Three papers from our group are accepted to EuroSys 2024!
[April 25, 2023] Junwei's paper "Towards Robust Graph Incremental Learning on Evolving Graphs" has been accepted to ICML 2023. Congratulations!
[February 18, 2023] Borui and Juntao's paper "Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training" has been accepted to MLSys 2023. Congratulations!
[December 2, 2022] Zhe and Ziyue's paper "Two-level Graph Caching for Expediting Distributed GNN Training" has been accepted to IEEE INFOCOM 2023. Congratulations!
[October, 2022] Ziyue Luo has graduated with Ph.D. and joined Ohio State University as a postdoc researcher. Congratulations!
[Sep 15, 2022] Yangrui's paper "SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training" has been accepted to NeurIPS 2022. Congratulations!
[Sep 6, 2022] Shiwei's paper "Accelerating Large-Scale Distributed Neural Network Training with SPMD Parallelism" has been accepted to ACM SOCC 2022. Congratulations!
[September, 2022] Bingqian Du has graduated with Ph.D. and joined Huazhong University of Science and Technology as an assistant professor. Congratulations!
[Jul 9, 2022] Yangrui's paper "BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing" (co-first-authored with Tsinghua collaborator) has been accepted to USENIX NSDI 2023. Congratulations!
[Jan 15, 2022] Hanpeng, Yuchen and Chenyu's paper "A Generic Performance Diagnosis and Optimization Toolkit for Expediting Distributed DNN Training" has been accepted to MLSys 2022. Congratulations!
[December 4, 2021] Ziyue's two papers have been accepted to IEEE INFOCOM 2022. Congratulations!
[August, 2021] Xiaodong Yi has graduated with Ph.D. and joined Tencent in Shenzhen as an AI technology researcher. Congratulations!
[March 25, 2021] I received an Amazon Research Award for carrying out research on compilation optimization in distributed DNN training 😃
[December 5, 2020] Zhe's first paper "Near-Optimal Topology-adaptive Parameter Synchronization in Distributed DNN Training" has been accepted to IEEE INFOCOM 2021. Congratulations!
[November 16, 2020] Yixin Bao has graduated with Ph.D. and joined Facebook at Seattle, U.S., as a research scientist. Congratulations!
[October 28, 2020] Xiaodong, Shiwei and Ziyue's paper "Optimizing Distributed Training Deployment in Heterogeneous GPU Clusters" has been accepted to ACM CoNEXT 2020. Congratulations!
[August 28, 2020] Xiaodong and Ziyue's paper "Fast Training of Deep Learning Models over Multiple GPUs" has been accepted to ACM/IFIP Middleware 2020. Congratulations!
[August 9, 2020] Yangrui, Yanghua and Yixin's paper "Elastic Parameter Server Load Distribution in Deep Learning Clusters" has been accepted to ACM SOCC'20. Congratulations!