- Luma Labs’ New Modify Video Tool for Dream Machine uses AI to change any video recordings without reshoots
- Any characters or environments do not lose their original movement or notions
- Everything from subtle wardrobe adjustments to full magic stage overhaul is feasible
Luma Labs is known for making AI videos from scratch, but the company has a new feature for its dream machine that can completely transform real video footage in subtle or obvious ways, even if it’s just an old home film.
The new Modify Video feature makes for videos something like the best photoshop tools do for images. It can change the setting, style of a stage, even whole characters, all without reforming, reanimation or even standing up.
The company boasts that AI video editing preserves everything that matters to you from the original recording, such as actor movement, framing, timing and other key information while changing everything else you want.
The clothes you wear that you decided was you not suddenly is a completely different set of clothes. This blanket Fort is now a ship sailing a stormy sea, and your friend flailing on the ground is actually an astronaut in space, all without the use of green screens or editing bays.
Luma’s combination of advanced movement and performance catch, AI styling, and what it calls structured presets, allows you to offer the full selection of reimaginated videos.
All you have to do is upload a video of up to 10 seconds in length to get started. Then select from the attached, Flex or Genimagine presets.
Adheres is the most subtle option; It focuses on minimal changes, such as the clothing adjustment below or different structures on furniture. Flex does it, but can also adjust the style of the video, lighting and others, more obvious details. Reimagine, as the name suggests, can completely re -record everything about the video, take it to another world or convert people into cartoon animals or send someone standing on a flat table in a cyberpunk hoverboard race.
Flexible AI video
It all depends on not only prompts, but reference pictures and selection of frame from your video if you choose. As a result, the process is much more user -friendly and flexible.
Although AI video modification is hardly unique to Luma, the company claims it surpasses rivals like Runway and Pika because of its performance of performance. The changed videos hold an actor’s body language, facial expression and lip synchronization. The final results occur as an organic whole, not just sewing bit.
Of course, the modification video tools have restrictions. These are still closed with 10 seconds per Cut for now, keeping things manageable in terms of waiting times. But if you want a longer movie, plan and find out how to artistically integrate different footage into a movie.
Still, features like the ability to isolate items within a shot are a big thing. Sometimes you have a performance you are very happy with, but it must be a different kind of character in another surrounding surroundings. Well, you can keep the performance intact and swap a garage to the sea and your actor’s legs for a fish tail.
Dreams to reality
It’s really impressive how fast and thoroughly AI tools can rework some recordings. These tools are not just a gimmick; The AI models are aware of performances and timelines in a way that feels closer to people than anything else I’ve seen. The AI models do not actually understand pace, continuity or structure, but they are very good at emulating these aspects.
While the technical and ethical limitations prevent Luma laboratories from recreating the entire cinema at this point, these tools will be tempting for many amateur or independent video producers. And while I don’t see it being as widespread as ordinary photo filters, there are some fun ideas in Luma’s demos that you might want to try.
