With one click, everything moves! Tencent Hunyuan joins forces with Tsinghua University and Hong Kong University of Science and Technology to launch Tuxing video model "Follow Your Click"

Editor | Produced by Yan Zheng

| 51CTO Technology Stack (WeChat ID: blog51cto)

On March 15, Tencent Hunyuan and Tsinghua University , the Hong Kong University of Science and Technology jointly launched a new Tusheng video model "Follow-Your-Click". Based on the picture input to the model, just click on the corresponding area and add a few prompt words to make the originally static area of ​​the picture move. Convert keys to video.

In the current Tusheng video large model, the general generation method not only requires the user to The prompt word describes the movement area and also needs to provide a detailed description of the movement instructions, which is a complicated process. In addition, from the perspective of generated effects, existing image generation video technology lacks control over moving specified parts of the image. The generated video often needs to move the entire scene, rather than a certain area on the image, and there is a lack of accuracy and flexibility. What is lacking.

In order to solve these problems, the joint project team of Tencent Hunyuan Large Model Team, Tsinghua University and Hong Kong University of Science and Technology proposed a more practical and controllable image-to-video generation model Follow-Your-Click , brings more convenient interaction, and also makes "one click on pictures, everything moves" a reality.

Image-to-video generation technology is used in many industries such as film content production, augmented reality, game production, and advertising. AIGC has broad application prospects and is one of the hottest AI technologies in 2024.

It is understood that the Tencent Hunyuan Large Model Team in this joint project team is continuing to research and explore multi-modal technology and has industry-leading video generation capabilities. Previously, Tencent Hunyuan Model, as a technical partner, supported the "People's Daily" in creating the original video "So Many Beautiful Rivers and Mountains", generating exquisite video clips of China's beautiful rivers and mountains, demonstrating strong content understanding, logical reasoning and pictures Generative ability.

Paper link: https://arxiv.org/abs/2403.08268

Github: https://follow-your-click.github.io/

The above is the detailed content of With one click, everything moves! Tencent Hunyuan joins forces with Tsinghua University and Hong Kong University of Science and Technology to launch Tuxing video model "Follow Your Click". For more information, please follow other related articles on the PHP Chinese website!