返回列表

veScale-FSDP: Flexible and High-Performance FSDP at Scale

Date: 2026-02-27Fetched: 2026-02-28T01:46:43.034557+00:00

Authors

Zezhou Wang, Youjie Li, Zhiqi Lin, Jiacheng Yang, Cong Xie, Guanyu Feng, Zheng Zhong, Ziyue Huang, Hongyu Zhu, Zhi Zhang, Yanghua Peng, Xin Liu

Links

veScale-FSDP 提出了一种重新设计的完全分片数据并行系统,采用灵活分片和结构感知规划,以提升大规模模型训练的可扩展性和效率。