14 H100 MIG 40GB models

Allen AITulu 3 8B Reward

Text embeddings
V3RewardBEIH100 MIG 40GB

Nomic AI logoNomic Embed Code

Text embeddings
BEIH100 MIG 40GB

Canopy Labs LogoOrpheus TTS

Text to speech
vLLMH100 MIG 40GB

Qwen LogoQwen 2.5 7B Math Instruct

LLM
2.5MathTRT-LLMH100 MIG 40GB

DeepSeek LogoDeepSeek-R1 Qwen 7B

LLM
R1QwenTRT-LLMH100 MIG 40GB

OpenAI logoWhisper (best performance)

Audio transcription
V3H100 MIG 40GB

Fixie LogoUltravox v0.4

LLM
0.4vLLMH100 MIG 40GB

Qwen LogoQwen 2.5 7B Coder Instruct

LLM
2.5CoderTRT-LLMH100 MIG 40GB

Qwen LogoQwen 2.5 7B Instruct

LLM
2.5TRT-LLMH100 MIG 40GB

Mistral AI logoMistral 7B Instruct

LLM
v3TRT-LLMH100 MIG 40GB

OpenAI logoWhisper V3

Audio transcription
V3H100 MIG 40GB

black forest labs logoflux-dev

Image generation
devbloat16H100 MIG 40GB

black forest labs logoflux-schnell

Image generation
schnellbfloat16H100 MIG 40GB

OpenAI logoWhisper V3 Turbo

Audio transcription
V3TurboH100 MIG 40GB

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G