microsoft/onnxruntime-genai v0.9.1

v0.9.1

Repository: microsoft/onnxruntime-genai

Tag: v0.9.1

Published: 2025-09-09T22:53:00Z

Prerelease: no

Release notes: 🚀 Features

Support for Continuous Batching (#1580) by @baijumeswani RegisterExecutionProviderLibrary (#1628) by @vortex-captain Enable CUDA graph for LLMs for NvTensorRtRtx EP (#1645) by @anujj Add support for smollm3 (#1666) by @xenova Add OpenAI's gpt-oss to ONNX Runtime GenAI (#1678) by @kunal-vaishnavi Add custom ops library path resolution using EP metadata (#1707) by @psakhamoori Use OnnxRuntime API wrapper for EP device operations (#1719) by @psakhamoori

🛠 Improvements

Update Extensions Commit to Support Strft Custom Function for Chat Template (#1670) by @sayanshaw24 Add parameters to chat template in chat example (#1673) by @kunal-vaishnavi Update how Hugging Face's config files are processed (#1693) by @kunal-vaishnavi Tie embedding weight sharing (#1690) by @jiafatom Improve top-k sampling CUDA kernel (#1708) by @gaugarg-nv

🐛 Bug Fixes

Fix accessing final norm for Gemma-3 models (#1687) by @kunal-vaishnavi Fix runtime bugs with multi-modal models (#1701) by @kunal-vaishnavi Fix BF16 CUDA version of OpenAI's gpt-oss (#1706) by @kunal-vaishnavi Fix benchmark_e2e (#1702) by @jiafatom Fix benchmark_multimodal (#1714) by @jiafatom Fix pad vs. eos token misidentification (#1694) by @aciddelgado

⚡ Performance & EP Enhancements

NvTensorRtRtx: Support num_beam > 1 (#1688) by @anujj NvTensorRtRtx: Skip if node of Phi4 models (#1696) by @anujj Remove QDQ and Opset Coupling for TRT RTX EP (#1692) by @xiaoyu-work

🔒 Build & CI

Enable Security Protocols in MSVC for BinSkim (#1672) by @sayanshaw24 Explicitly specify setup-java architecture in win-cpu-arm64-build.yml (#1685) by @edgchen1 Use dotnet instead of nuget in mac build (#1717) by @natke

📦 Versioning & Release

Update version to 0.10.0 (#1676) by @ajindal1 Cherrypick 0: Forgot to change versions (#1721) by @aciddelgado Cherrypick 1... Becomes RC1 (#1726) by @aciddelgado Cherrypick 2 (#1743) by @aciddelgado

🙌 New Contributors

@xiaoyu-work (#1692) @psakhamoori (#1707)

✅ Full Changelog: v0.9.0...v0.9.1