Deploy models with live reload workflow
Real-world model deployment workflows can be a bit messy. The latest version of the Baseten Python client, version 0.3.0 , gives you a cleaner path to production by introducing a live reload workflow...
Changelog | Page 7
See our latest feature releases, product improvements and bug fixes
Feb 3, 2023
Jan 24, 2023
Fix issues faster with improved logs UI
The only thing more frustrating than your code not working is not knowing why it isn't working. To make it easier to root-cause issues during model deployment and invocation, we separated build logs...
Jan 13, 2023
Truss 0.2.0: Improved developer experience
Truss is an open-source library for packaging and serving machine learning models. In the latest minor version release, 0.2.0, we simplified the names of several core functions in Truss to create a...
Jan 5, 2023
Manage your models with updated UI
The new user interface for models centers model versions. Previously in their own tab, model versions now have a dedicated sidebar to help you navigate different deployments of your model and review...
Dec 23, 2022
Configure your model resources
By default, models deployed on Baseten run on a single instance with 1 vCPU and 2 GiB of RAM. This instance size is sufficient for some models and workloads, but demanding models and high-traffic...
Dec 13, 2022
Enable live reload with draft models
Slow dev loops break flow state and make for a frustrating experience. And for data scientists, slow dev loops make all but the most essential deployment workflows too expensive and time consuming to...
Nov 29, 2022
Weekly round-up: Deploy Flan-T5 XL on Baseten
Flan-T5 XL is an open-source large language model developed by Google. Flan-T5 is an instruction-tuned model, meaning that it exhibits zero-shot-like behavior when given instructions as part of the...
Nov 15, 2022
Weekly round-up: Live reload Truss in Docker dev environment
The latest release of Truss, version 0.1.5 , introduces a live reload mechanic to improve developer velocity when working with Docker. Docker is great because it makes your development environment...
Nov 8, 2022
Weekly round-up: Python environment per application
Until today, applications on your Baseten account shared a single Python environment. Now, you can install Python packages from PyPi or system packages like ffmpeg on an app-by-app basis. What’s...
Nov 3, 2022
Special issue: Deploy MLflow models on Baseten
Baseten now supports MLflow models via Truss. MLflow is a popular library for model experimentation and model management with over ten million monthly downloads on PyPi. With MLflow, you can train a...
