veScale-FSDP: Flexible and High-Performance FSDP at ScaleDate: 2026-02-27Fetched: 2026-02-28T01:46:43.034557+00:00AuthorsZezhou Wang, Youjie Li, Zhiqi Lin, Jiacheng Yang, Cong Xie, Guanyu Feng, Zheng Zhong, Ziyue Huang, Hongyu Zhu, Zhi Zhang, Yanghua Peng, Xin LiuLinksHFarXivPDFGitHub3Abstract中文摘要EnglishveScale-FSDP 提出了一种重新设计的完全分片数据并行系统,采用灵活分片和结构感知规划,以提升大规模模型训练的可扩展性和效率。