Dexter Studios(206560, hereinafter “Dexter”), a leading comprehensive content company, has strengthened its competitive edge in VFX production technology by acquiring a new patent for video generation technology based on 4D high-precision dynamic volumetric facial data (3D facial data including a time axis; hereinafter “4D facial mesh”).
Dexter announced that it has completed the patent registration for the “Method of Generating Digital Video through 4D Mesh Sequence Editing Preserving Natural Head Movement.” This technology allows for the precise modification of facial expressions alone, while preserving the natural movements of an actor—such as nodding or tilting their head—when their performance is captured into dynamic volumetric facial data by 3D-scanning it dozens of times per second for VFX or animation production. A key feature of this technology is that it not only elevates the quality of expression compared to traditional production methods but also significantly boosts editing efficiency.
Traditional 4D facial mesh editing technologies required a “Mesh Stabilization” process, which involved removing head movements to match facial alignment between each frame when modifying expressions. During this process, key performance (acting) data—such as head nods, tilts, and rotations that carry the actor’s expressiveness—was lost, making it difficult to convey realistic emotions.
The newly patented technology features an editing method that processes overall head movement and detailed facial expressions separately. By preserving the actor’s head movements while allowing detailed editing of facial expressions into the desired form, it can recreate actual acting and emotions much more naturally.
This technology enables inserting desired expressions into specific frames or modifying and correcting existing ones. As a result, it can reduce additional production costs and time caused by reshoots or pickup shots due to issues in certain scenes. Furthermore, by acquiring precise performance data (head movements, facial expressions, etc.) for a few key sequences, it is possible to use an AI model trained on this data to generate performance data for segments that were not initially captured.
The technology is expected to contribute to realistic character creation and improved production efficiency across various content production fields, given its wide range of applications. These include digital human production that recreates virtual character performances based on high-precision actor performance data, performance capture-based animation production, and “facial animation retargetting,” which replicates an actor’s movements and expressions onto another actor’s face.
Song Jae-won, Director of Dexter’s R&D Center, stated, “Dexter is continuously introducing AI-integrated VFX technologies, such as AI re-aging (aging and de-aging) and face swapping, thereby establishing a next-generation VFX production pipeline.” He added, “Dexter’s key differentiator lies in developing AI VFX technology that significantly improves efficiency compared to existing methods while maintaining a level of quality suitable for commercial content production.”
ⓒ Dexter Studios
