basetenlabs/truss-examples: Examples of models deployable with Truss

11 hours ago

Truss Examples

Truss is the simplest way to serve AI/ML models in production.

To get you started with Truss, this repository has dozens of example models, each ready to deploy as-is or adapt to your needs.

Get the repository with:

git clone https://github.com/basetenlabs/truss-examples

Install Truss with:

pip install --upgrade truss

Pick a model to deploy by passing a path to that model.

$ # From the truss-examples directory
$ truss push 02-llm

This will prompt you for an API Key -- fetch one from the Baseten API keys page.

See the BEI-Bert examples for EmbeddingGemma, Laya, Rune 26B, Perplexity Decider, Cloudflare Clef, Qwen3 embeddings, and ModernBERT reranking.

Invocation depends on the model's input and output specifications. See individual model READMEs for invocation details.

We welcome contributions of new models and improvements to existing models. See CONTRIBUTING.md for details.

You finished the article!

Want to go deeper or explore more stories?

Adjust typography and theme to your preference.

Typography

Text Scale