OpenBMB/BMTrain v1.0.0

BMTrain v1.0.0

Repository: OpenBMB/BMTrain

Tag: v1.0.0

Published: 2024-02-26T05:37:11Z

Prerelease: no

Release notes:

What's Changed

• Using pytorch's hook mechanism to refactor ZeRO, checkpoint, pipeline, communication implementation by @zkh2016 in #128 #159
• Add Bf16 support by @Achazwl in #136
• Tensor parallel implementation by @Achazwl @zkh2016 @MayDomine in #153
• Async save state_dict by @zkh2016 in #171
• AdamOffloadOptimizer can save whole gathered state by @MayDomine in #184
• New test for new version BMTrain by @Achazwl @JerryYin777 @MayDomine

Full Changelog: https://github.com/OpenBMB/BMTrain/compare/0.2.3...1.0.0