- Bytedance shows the new Omnihuman AI video model.
- Omnihuman transforms a single photo into a lifelike video with full body.
- The videos show realistic song, speech and movement.
Tiktok’s parent company, bytedance, shows a new AI video creator that can produce live videos of people who speak, sing and move around from a single photograph. The new omnihuman model can bring a picture to life with creepy accurate body movements, facial expressions and movements.
Omnihuman’s breakthrough involved training on more than 18,700 hours of video. AI can now mimic how people move, speak and interact in videos. In particular, this AI can create fully moving figures instead of just animate a face or upper body. This means that a single image can be transformed into a video of someone holding a speech, dance or even playing an instrument.
The result is a very realistic video, whether the character is a human from a photograph or one from a more stylized painting. You can see examples below.
Omnihuman everywhere
If and when bytance makes Omnihuman available, it’s easy to imagine it blasting on Tiktok. The company is already offering an AI-Video maker named Jimeng on the platform, and something that Omnihuman could lure many more people to play with Tiktok and its other features.
Of course, urban dancing does not come space without competition. Openais Sora has drawn recognitions and is a big name in the AI video area, but there are plenty of others, such as Pika, Runway, Rollo and Luma Labs’ Dream Machine.
There is a lot of potential use for Bytedance’s model, whether it is to recreate actors from the past to several films or teaching students history from the simulated mouths of historical characters. Even digital avatars for social media and games could become more lifelike, real -time adjustment based on user input.
Omnihuman is still a research project for now, but the fact that city dancing is already showing its capabilities suggests that practical applications are not far behind. The AI character below could be the next face of a video end on Tiktok.
