6 H100 MIG 40GB models

OpenAI logoWhisper (best performance)

Audio transcription
V3H100 MIG 40GB

Fixie LogoUltravox v0.4

LLM
0.4vLLMH100 MIG 40GB

OpenAI logoWhisper V3

Audio transcription
V3H100 MIG 40GB

black forest labs logoflux-dev

Image generation
devbloat16H100 MIG 40GB

black forest labs logoflux-schnell

Image generation
schnellbfloat16H100 MIG 40GB

OpenAI logoWhisper V3 Turbo

Audio transcription
V3TurboH100 MIG 40GB

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten πŸ‘‹ πŸ‘½

INFO

πŸš€ Uploading model to Baseten πŸš€

Upload progress: 0% | | 0.00G/2.39G