friendliai/friendli-model-optimizer v0.7.0
friendliai/friendli-model-optimizer
Captured source
source ↗published Sep 25, 2024seen 5dcaptured 8hhttp 200method plain
Release v0.7.0🚀
Repository: friendliai/friendli-model-optimizer
Tag: v0.7.0
Published: 2024-09-25T06:56:37Z
Prerelease: no
Release notes:
- Further optimization for running FP8, and INT8 quantization.
- Support searching automatic calibration dataset batch size for running FMO.
- Support [AWQ(Activation-aware Weight Quantization)].
Notability
notability 4.0/10Routine version update of a model optimizer tool