basetenlabs/truss-examples

basetenlabs/truss-examples

Description: Examples of models deployable with Truss

Language: Python

License: MIT

Stars: 227

Forks: 62

Open issues: 77

Created: 2023-07-17T02:16:09Z

Pushed: 2026-06-10T20:23:54Z

Default branch: main

Fork: no

Archived: no

README:

Truss Examples


Truss is the simplest way to serve AI/ML models in production.

To get you started with Truss, this repository has dozens of example models, each ready to deploy as-is or adapt to your needs.

Installation

Get the repository with:

git clone https://github.com/basetenlabs/truss-examples

Install Truss with:

pip install --upgrade truss

Deployment

Pick a model to deploy by passing a path to that model.

$ # From the truss-examples directory
$ truss push 02-llm

This will prompt you for an API Key -- fetch one from the Baseten API keys page.

Invocation

Invocation depends on the model's input and output specifications. See individual model READMEs for invocation details.

Contributing

We welcome contributions of new models and improvements to existing models. See [CONTRIBUTING.md](CONTRIBUTING.md) for details.