Baseten

New in May 2024

AI events, multicluster model serving architecture, tokenizer efficiency, and forward-deployed engineering

Use four new best in class LLMs, stream synthesized speech with XTTS, and deploy models with CI/CD

Fast Mistral 7B, fractional H100 GPUs, FP8 quantization, and API endpoints for model management.

3x throughput with H100 GPUs, 40% lower SDXL latency with TensorRT, and multimodal open source models.

A library for open source models, general availability for L4 GPUs, and performance benchmarking for ML inference

Faster Mixtral inference, Playground v2 image generation, and ComfyUI pipelines as API endpoints.

Switching to open source ML, a guide to model inference math, and Stability.ai's new generative AI image-to-video model.

All-new model management, a text embedding model that matches OpenAI, and misgif, the most fun you’ll have with AI all week.

Baseten provides all the infrastructure you need to deploy and serve ML models performantly, scalable, and cost-efficiently.