Configure model hardware with new resource selector

Every deployment of an ML model requires certain hardware resources — usually a GPU plus CPU cores and RAM — to run inference. We’ve made it easier to navigate the wide variety of hardware options available on Baseten with a new instance type selection page.

On this page, you can select GPU type (or no GPU at all), GPU count, and associated CPU resources. To help guide you through these options, we have docs on available instance types and a series of blog posts on GPU options. Don’t hesitate to reach out to support@baseten.co if you have any questions about which hardware resources are best for your model inference workload.

✕