14-01-2021 дата публикации
Номер: US20210012090A1
Принадлежит:
Provided are systems and a method for photorealistic real-time face reenactment. An example method includes receiving a target video including a target face and a scenario including a series of source facial expressions, determining, based on the target face, one or more target facial expressions, and synthesizing, using the parametric face model, an output face. The output face includes the target face. The one or more target facial expressions are modified to imitate the source facial expressions. The method further includes generating, based on a deep neural network, a mouth region and an eyes region, and combining the output face, the mouth region, and the eyes region to generate a frame of an output video. 1. A method for face reenactment , the method comprising:receiving, by a computing device, a target video, the target video including at least one target frame, the at least one target frame including a target face;receiving, by the computing device, a scenario including a series of source facial expressions;determining, by the computing device and based on the target face in the at least one frame of the target video, one or more target facial expressions;synthesizing, by the computing device and using a parametric face model and a texture model, an output face, the output face including the target face, wherein the one or more target facial expressions are modified to imitate the source facial expressions of the series of source facial expressions;generating, by the computing device and based on a deep neural network (DNN) and at least one previous frame of the target video, a mouth region and an eyes region; andcombining, by the computing device, the output face, the mouth region, and the eyes region to generate a frame of an output video.2. The method of claim 1 , wherein the parametric face model depends on a facial expression claim 1 , a facial identity claim 1 , and a facial texture.3. The method of claim 1 , wherein the parametric face model includes ...
Подробнее