15 A100 models

NVIDIA logoLlama 3.1 Nemotron 70B

LLM
3.1NemotronA100

ByteDance logoSDXL Lightning

Image generation
1.0LightningA100

Stability AI logoStable Diffusion 3 Medium

Image generation
3A100

Meta logoLlama 3 8B Instruct

LLM
3InstructA100

Stability AI logoStable Video Diffusion

Image to video
Video 1.0A100

Mistral AI logoPixtral 12B

LLM
PixtralvLLMA100

google logoGemma 2 9B

LLM
vLLMA100

google logoGemma 2 27B

LLM
vLLMA100

Meta logoLlama 3 8B Instruct TRT-LLM

LLM
3InstructTRT-LLMA100

Mistral AI logoMistral 7B Chat TRT-LLM

LLM
v1ChatTRT-LLMA100

Mistral AI logoMixtral 8x7B

LLM
v1ChatTRT-LLMA100

volcanoLlava 1.6 34B

Image classification
v1.6A100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G