Lightning-AI/litgpt v0.5.9

v0.5.9

Repository: Lightning-AI/litgpt

Tag: v0.5.9

Published: 2025-06-12T20:51:14Z

Prerelease: no

Release notes:

What's Changed

• input_pos_maxp1 as a Python integer by @Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/2016
• add testing for py3.12 & py3.13 by @Borda in https://github.com/Lightning-AI/litgpt/pull/2025
• ci: update guardian for PRs by @Borda in https://github.com/Lightning-AI/litgpt/pull/2043
• Add devcontainer by @twsl in https://github.com/Lightning-AI/litgpt/pull/2035
• Remove dependency from config to utils by @lukemerrick in https://github.com/Lightning-AI/litgpt/pull/2034
• fix: Add fallback chat template by @andyland in https://github.com/Lightning-AI/litgpt/pull/2040
• Add optional sys prompt by @twsl in https://github.com/Lightning-AI/litgpt/pull/2036
• fix: Pretraining text files with recent litdata versions by @andyland in https://github.com/Lightning-AI/litgpt/pull/2048
• tests: mark test_evaluate_script as flaky by @Borda in https://github.com/Lightning-AI/litgpt/pull/2049
• simplify the GPU testing flow by @Borda in https://github.com/Lightning-AI/litgpt/pull/2053
• ci: extend testing with ubuntu-24.04 by @Borda in https://github.com/Lightning-AI/litgpt/pull/2056
• Remove litserve version constraint by @twsl in https://github.com/Lightning-AI/litgpt/pull/2055
• req: pin bitsandbytes>=0.45.2,<0.45.5 by @Borda in https://github.com/Lightning-AI/litgpt/pull/2057
• ci: use Thunder dev images for testing by @Borda in https://github.com/Lightning-AI/litgpt/pull/2054
• Update spacing in README.md by @Borda in https://github.com/Lightning-AI/litgpt/pull/2058
• Transformers version bump by @KaelanDt in https://github.com/Lightning-AI/litgpt/pull/2029
• Qwen3 Dense by @ysjprojects in https://github.com/Lightning-AI/litgpt/pull/2044
• phi-4 reasoning models by @ysjprojects in https://github.com/Lightning-AI/litgpt/pull/2047
• adding logger args by @ysjprojects in https://github.com/Lightning-AI/litgpt/pull/1973
• Qwen3 MoE Preliminary: add intermediate_size argument to MLP modules by @ysjprojects in https://github.com/Lightning-AI/litgpt/pull/2046
• OLMo 2 by @ysjprojects in https://github.com/Lightning-AI/litgpt/pull/1897
• bump: testing with PT 2.7.1 by @Borda in https://github.com/Lightning-AI/litgpt/pull/2063
• Add Dependabot for Pip & GitHub Actions by @Borda in https://github.com/Lightning-AI/litgpt/pull/2066
• build(deps): bump litdata from 0.2.45 to 0.2.49 by @dependabot in https://github.com/Lightning-AI/litgpt/pull/2068

New Contributors

• @twsl made their first contribution in https://github.com/Lightning-AI/litgpt/pull/2035
• @lukemerrick made their first contribution in https://github.com/Lightning-AI/litgpt/pull/2034
• @prabhuteja12 made their first contribution in https://github.com/Lightning-AI/litgpt/pull/2027
• @andyland made their first contribution in https://github.com/Lightning-AI/litgpt/pull/2040
• @KaelanDt made their first contribution in https://github.com/Lightning-AI/litgpt/pull/2029

Full Changelog: https://github.com/Lightning-AI/litgpt/compare/v0.5.8...v0.5.9