Tencent Technology (Shenzhen) Co., Ltd. applied for a patent entitled "method and device for replacing human faces in videos to be played", IT House reported on March 24.
The present disclosure provides a method and a device for replacing a human face in a video to be played. The method includes: identifying the first face from the decoded frame data of the video to be played; taking the identified key points of the first face as vertices, carrying out 3D modeling to obtain the 3D model, so that the vertex coordinates of the 3D model are synchronized with the key point coordinates of the first face in the video to be played; obtaining the second face; and applying the acquired second face as a texture to the 3D model.
The present disclosure provides a technique for replacing a face in a video with another person's face, which can restore features such as face orientation and expression in the video.
IT House learned from the State intellectual property Office that Tencent applied for a patent called "a face replacement method and device" in 2016, which can avoid the problem that the target character does not match the original image, improve the replacement effect, and is currently in a state of rejection.