Baidu's patent for 'Generating Digital People Based on Scenarios” is authorized and can be applied to the Metaverse

IT Home News on June 9th, the patent "Methods for Generating Digital Humans, Model Training Methods, Devices, Equipment and Media" applied by Beijing Baidu Netcom Technology Co., Ltd. was authorized.

IT Home obtained from the patent summary that the patent provides a method for generating digital humans, a model training method, a device, equipment and a medium, involving the field of artificial intelligence, specifically involving natural language processing, deep learning, computers Technical fields such as vision, image processing, augmented reality and virtual reality can be applied to scenarios such as the Metaverse. The implementation plan is: Obtain the material content; based on the pre-trained scene division model, determine multiple scenes from the material content.

Among them, each scene in the multiple scenes corresponds to a content fragment with complete semantic information in the material content; and for each scene in the multiple scenes, based on the corresponding content fragment, determine the scene corresponding the target content; based on the corresponding target content, determine the scene tag information of the scene; and based on the scene tag information, configure a digital person specific to the scene.

The patent states that the use of digital humans in videos is mainly based on templates. For example, if a fixed digital human is used for broadcasting, the digital human may be separated from the content when broadcasting. The broadcast content does not match the image of the digital human. Poor user experience.

This patent divides the material content into scenes and configures the digital human at the scene granularity. This ensures the consistency between the digital human and the scene and the target content, and improves the relationship between the material content and the digital human. The integration of time and space improves users’ experience of watching digital people.

The above is the detailed content of Baidu's patent for 'Generating Digital People Based on Scenarios” is authorized and can be applied to the Metaverse. For more information, please follow other related articles on the PHP Chinese website!