Weekly round-up: Deploy OpenAI Whisper instantly
We added Whisper, a best-in-class speech-to-text model, to our library of pre-trained models. That means you can deploy Whisper instantly on your Baseten account and build applications powered by the most sophisticated transcription model available.
You can deploy Whisper from its model page in the Baseten app. Just sign in or create an account and click “Deploy.” The model and associated starter app will be added to your workspace instantly. Or, try the model first with our public demo.
Review improved model logs
In a comprehensive overhaul, we made model logs ten times shorter but way more useful. Here’s what we changed:
Build logs are now separated into steps for easier skimming
Model deployment logs are surfaced just like build logs
Model OOMs are now reported
Many extraneous log statements have been deleted
OOM logging is a particularly important improvement. An OOM, or out-of-memory error, is a special lifecycle event that we monitor for on Kubernetes. This error means that the model is too big for the infrastructure provisioned for it. Existing logging solutions don’t capture these errors, resulting in frustrating debugging sessions, so we built a special listener to let you know about OOMs right away.
