ReleaseFriendliAIFriendliAIpublished Sep 25, 2024seen 5d

friendliai/friendli-model-optimizer v0.7.0

friendliai/friendli-model-optimizer

Open original ↗

Captured source

source ↗
published Sep 25, 2024seen 5dcaptured 8hhttp 200method plain

Release v0.7.0🚀

Repository: friendliai/friendli-model-optimizer

Tag: v0.7.0

Published: 2024-09-25T06:56:37Z

Prerelease: no

Release notes:

  • Further optimization for running FP8, and INT8 quantization.
  • Support searching automatic calibration dataset batch size for running FMO.
  • Support [AWQ(Activation-aware Weight Quantization)].

Notability

notability 4.0/10

Routine version update of a model optimizer tool