arcee-ai/fastmlx v0.2.0

v0.2.0

Repository: arcee-ai/fastmlx

Tag: v0.2.0

Published: 2024-08-06T10:07:21Z

Prerelease: no

Release notes:

What's New

1. Environment Configuration (PR #15 by @SiddhantSadangi):

• Set workers through environment variables
• Improved default settings

2. Tool Calling Support (PR #21 by @Blaizzy):

• Added functionality for tool calling
• Supports parallel tool calling mode
• Models
• Llama 3.1
• Arcee Agent
• Firefunction
• xLAM
• C4AI-Command-R-Plus
• Modes
• Standard (Without Streaming)
• Parallel Tool Calling

3. Refactor Vision Language Models stream_generate (PR #21 by @Blaizzy).

New Contributors

• @SiddhantSadangi made their first contribution in https://github.com/Blaizzy/fastmlx/pull/15

Full Changelog: https://github.com/Blaizzy/fastmlx/compare/v0.1.0...v0.2.0