Lightning-AI/LitServe v0.2.18

Release v0.2.18

Repository: Lightning-AI/LitServe

Tag: v0.2.18

Published: 2026-08-12T08:42:22Z

Prerelease: no

Release notes:

What's Changed

Added

• Support context argument in batch/unbatch methods by @discobot in #711
• Support per-API worker counts by @sanggusti in #646

Changed

• Rename meta_kwargs to context_kwargs and fix type hints by @bhimrazy in #651
• Extend CI matrix with Python 3.12/3.13 and cross-platform testing by @bhimrazy in #644
• Migrate PyPI release to trusted publishing by @bhimrazy in #709
• Pin GitHub Actions to verified commit SHAs by @bhimrazy in #689
• Add 2-day package install cooldown in CI by @bhimrazy in #691
• Pin docformatter Python version by @bhimrazy in #690
• Add Code of Conduct, Contributing, and Governance docs by @bhimrazy in #721

Fixed

• Fix authentication bypass in multi-API deployments by @Lidang-Jiang in #674
• Fix health check reliability: exception handling, stale status, and concurrency by @Lidang-Jiang in #673
• Fix health check returning 200 when no workers registered by @daigo0927 in #664
• Fix streaming response cleanup and guard dispatcher against late responses by @KAVYANSHTYAGI in #653
• Fix azip to propagate async stream failures by @KAVYANSHTYAGI in #654
• Resolve flaky tests across platforms and Python versions on main by @bhimrazy in #649
• Use module loggers instead of print() by @racinmat in #707
• Replace expired Discord invite in README by @bhimrazy in #722
• Pin `hatchling

Chores

• Bump mypy 1.19.0 → 1.19.1 → 1.20.0 → 2.1.0 → 2.3.0 (dependabot) in #647, #672, #692, #723
• Bump rich requirement >=14.0.0 → >=15.0.0 (dependabot) in #679
• Bump codecov/codecov-action 5 → 6 (dependabot) in #671
• GHA dependency group bumps (dependabot) in #645, #666, #720
• pre-commit.ci suggestions in #648, #652, #665, #675, #680

New Contributors

• @sanggusti made their first contribution in https://github.com/Lightning-AI/LitServe/pull/646
• @daigo0927 made their first contribution in https://github.com/Lightning-AI/LitServe/pull/664
• @Lidang-Jiang made their first contribution in https://github.com/Lightning-AI/LitServe/pull/674
• @racinmat made their first contribution in https://github.com/Lightning-AI/LitServe/pull/707
• @discobot made their first contribution in https://github.com/Lightning-AI/LitServe/pull/711

Thank you ❤️ to all contributors for making LitServe better!

Full Changelog: https://github.com/Lightning-AI/LitServe/compare/v0.2.17...v0.2.18