Stable Video Diffusion now available

Stable Video Diffusion announcement

Yesterday, Stability AI announced the release of Stable Video Diffusion, marking a huge leap forward for open source novel video synthesis. 

✕

Animated koi fish in a pond generated by SDXL + Stable Video Diffusion

This new system builds on the image synthesis capabilities of Stable Diffusion to generate a high-quality, coherent video from a single still image. The system is trained to take one image as input and produce a 14 or 25 frame video that continues the scene or action depicted in that seed image. While it was trained on 576x1024 resolution data, it can extrapolate to other dimensions, similar to Stable Diffusion.

Stable Video Diffusion is now available for researchers and developers to deploy in their own applications. This represents an exciting advancement that unlocks new possibilities for video creation and editing.

✕

Astronaut riding a horse generated by SDXL + Stable Video Diffusion

What you can do with Stable Video Diffusion

The possibilities are endless, but some potential use cases include:

• Stock footage: animate still stock photos to create customizable b-roll and background videos

• Personal photos: make an old family photo come alive by having the AI generate a short video clip from it

• Presentations: supplement slides and images with AI-generated video clips to hold audience attention

• Film previsualization: Storyboard scenes of your film or video project with AI-generated video clips before shooting

• And so much more.

The key benefit over previous video AI models is that Stability AI's new model produces coherent, high-quality results that look believable while matching closed-source performance.

Performance vs competition

In qualitative evaluations, Stability found Stable Video Diffusion to surpass the most successful video generation models that are already out there.

✕

Qualitative evaluation of Stable Video Diffusion vs. Pika Labs and Runway (from Stability AI)

The model also can be fine-tuned on downstream data on a wide range of tasks, such as multi-view synthesis from a single image.

✕

Claymation sailboat generated by SDXL + Stable Video Diffusion

For those looking to leverage video synthesis capabilities in their products, experiments, or workflows, this announcement opens up an exciting new opportunity. Contact us to deploy Stable Video Diffusion onto a performant, custom instance in a single click.