Stability AIS videos have added text and images with movement and life for a few years, but now literally adds a new dimension by converting two-dimensional images into three-dimensional videos.
The company’s new stable virtual camera tool is designed to process even a single image for a moving, multi-perspective video, which means you can rotate around and watch the movie from any angle.
It is not quite a new concept as virtual cameras have long been a staple with film creation and animation that lets creaters navigate and manipulate digital scenes. But stability AI has taken this concept and thrown in a heavy dose of generative AI. The result means that instead of requiring detailed 3D stage structures or carefully calibrated camera settings, stable virtual camera users generate smooth, depth-sound-like 3D movement from even a single image, all with minimal effort.
What makes this different from other AI-generated video tools is that it doesn’t just guess its way through animation and rely on huge data sets or frame-for-frame-reconstructions. Stable virtual camera uses a multi-view diffusion process to generate new angles based on the included image, so the result looks like a model that could actually exist in the real world.
Look at
The tool allows users to control camera with cinematic precision, choose between movements such as zoom, rotating lane or even a spiral. The resulting video can be in vertical shape for mobile devices or widescreen if you have a cinema. The virtual camera can work with only one image but will handle up to 32.
Stability AI has made the model available under a non-commercial license for research purposes. This means you can play with it if you have some technical ability by grabbing the code from GitHub. Going open source as stability AI usually also means that the AI developer community can refine and expand the virtual camera’s capabilities without the company having to pay.
3D AI
Of course, no AI model is perfect and stability AI is in advance that kinks are still being prepared. If you were hoping to generate realistic people, animals or especially chaotic structures (like water), you may end up with something that belongs in a low-budget horror film.
Don’t be surprised if you watch videos made with it with perspectives that awkward travel through objects or have perspective shifts leading to flickering, ghost -rich artifacts. Whether this will be a widely adopted tool or just another AI gimmick ignored by dedicated filmmakers is to see.
Not to mention how much competition it faces among AI video tools Openais Sora, Pika, Runway, Pollo and Luma Labs’ Dream Machine. Stable virtual camera will have to show that it works well in the real world of filming to go beyond just another fun demovideo.
