Home Technology peripherals AI The Volcano Engine 4K restoration film was selected for the Beijing Film Festival, and related technology won the championship at CVPR2024

The Volcano Engine 4K restoration film was selected for the Beijing Film Festival, and related technology won the championship at CVPR2024

Apr 22, 2024 pm 02:10 PM
Tik Tok industry lsp

On April 18, the 14th Beijing International Film Festival officially opened. The Hong Kong films "Plan A" and "The Pledge of Allegiance" jointly restored by the China Film Archive, Douyin and Volcano Engine were selected into the "Tribute and Restoration" section and will be screened on April 18th and 19th.

火山引擎4K修复影片入选北影节 相关技术在CVPR2024夺冠

4K version of "Plan A" and "Pact of Promise" movie posters

"Plan A" and "Pact of Promise" were released in 1983 and 1978 respectively. It has been more than forty years ago. In August 2023, the China Film Archive, Douyin and Volcano Engine jointly launched the "Classic Hong Kong Movie Restoration Project" and announced the restoration of 100 Hong Kong movies. The two films screened this time come from the above-mentioned projects. The original filming negatives of the films were scanned in 4K format in Hong Kong. The entire restoration process included physical and digital restoration by the China Film Archive, AI technology restoration by Volcano Engine, and cooperation between the two parties. Art restoration and other aspects.

Volcano Engine is a cloud service platform owned by ByteDance. It has worked with Xigua Video and Douyin to complete 4K restoration of 100 domestic classic animations and Beyond classic concerts.

In the "Classic Hong Kong Movie Restoration Project", Volcano Engine applied AIGC technology to old film restoration scenes for the first time, using the powerful generation capabilities of large visual models and rich prior knowledge to achieve restoration effects with higher clarity. , color, fluency and defect elimination, word count: 78.

On the one hand, the large model generation ability is strong. With the help of Stable Diffusion large model generation ability, the repair effect is better than the previous algorithm, and the picture details are more natural; on the other hand, the large model has a very strong information structure. After learning massive data pairs, a large amount of knowledge can be extracted and "stored" in model parameters. Its generation space is richer and can cope with more repair scenarios. Wang Yue, director of video cloud technology architecture of Volcano Engine, introduced.

Currently, the Volcano Engine has made a series of algorithm and engineering optimizations to address issues such as the tendency of large visual models to generate artifacts or false textures in certain scenes, as well as the stability of multi-frame video scenes. It improves the processing efficiency and takes into account the computing power cost in large model scenarios.

According to the in-depth repair work, the Volcano Engine Multimedia Laboratory has carried out a one-step refinement of the large visual model by introducing adaptive feature weighting modules, a combination of unsupervised learning and supervised learning, and text semantic priors. Tuning. It has achieved good results in several aspects such as reconstruction of extremely low-quality portraits, color adjustment of faded film, and generation of missing strokes in text.

火山引擎4K修复影片入选北影节 相关技术在CVPR2024夺冠

Before repair vs after repair


##

Comparison before and after color adjustment of faded film

In order to maintain the "renovated as old" texture of the original film, the technical team not only improved the smoothness of damaged image textures, night scene noise removal and other effects, but also An adaptive texture enhancement scheme was specially developed to add grain that simulates film noise.

At the same time, solving various practical problems in the restoration of old films also provides value to the academic research of the Volcano Engine Multimedia Laboratory. In the top computer vision conference CVPR 2024, the Volcano Engine Multimedia Laboratory won the championship in the NTIRE ( New Trends in Image Restoration and Enhancement) track. Its winning plan was based on The main problem solved by prompt learning (Prompt Learning) image enhancement recovery is to repair unpredictable complex damage (unknown complex degradation) similar to a large number of old movies.

"We actually do the restoration of old films every day." Wang Yue said that common image quality problems such as low definition, low fluency, color distortion, and defects in old films have been restored in It is also widely found in Douyin’s massive submissions. By serving Douyin, Huoshan Engine has formed a relatively complete set of intelligent processing technology solutions for the restoration of old films.

Public information shows that the film restoration process is complicated and trivial, and it takes an experienced restorer one month to complete a film. In recent years, through deep learning and other AI technologies, it has become possible to significantly improve the quality and efficiency of old film restoration.

Ma Kede, assistant professor of the Department of Computer Science at City University of Hong Kong, said that the current rapid development of artificial intelligence technology has shown great potential. In the future, not only the problem of out-of-synchronization of audio and video in some old movies will be solved more effectively through AIGC The solution is even expected to allow AI to learn to automatically judge the repair effect.

Old Hong Kong films carry the youthful memories of many viewers. Jackie Chan’s superb acting skills and thrilling action scenes in "Plan A", as well as Xu Guanwen's humorous performance in "The Pledge of Allegiance" have brought audiences Countless surprises are coming, and with the improvement of restoration technology, these classics from the past will be revived.

During the pre-screening activities of "Plan A", senior film producer Sun Rong, who was the vice president of Jackie Chan China, shared with fans on the spot that Jackie Chan previously thought that the light in the tunnel in "Eagle Project" was not bright enough. , the "Classic Hong Kong Film Restoration Project" team made adjustments based on the opinions and made up for the regrets of his creation back then.

火山引擎4K修复影片入选北影节 相关技术在CVPR2024夺冠

Sun Rong, founder of Dinosaur Pictures, former vice president of Jackie Chan China and vice president of Sparkle Films, shared before the screening

Currently, the audience is on Douyin , Xigua Video, you can watch movies that have been restored by the "Classic Hong Kong Movie Restoration Project" online, and 4K restored versions of other movies will also be launched online one after another.

火山引擎4K修复影片入选北影节 相关技术在CVPR2024夺冠

火山引擎4K修复影片入选北影节 相关技术在CVPR2024夺冠

The above is the detailed content of The Volcano Engine 4K restoration film was selected for the Beijing Film Festival, and related technology won the championship at CVPR2024. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

The first mechanical claw! Yuanluobao appeared at the 2024 World Robot Conference and released the first chess robot that can enter the home The first mechanical claw! Yuanluobao appeared at the 2024 World Robot Conference and released the first chess robot that can enter the home Aug 21, 2024 pm 07:33 PM

On August 21, the 2024 World Robot Conference was grandly held in Beijing. SenseTime's home robot brand "Yuanluobot SenseRobot" has unveiled its entire family of products, and recently released the Yuanluobot AI chess-playing robot - Chess Professional Edition (hereinafter referred to as "Yuanluobot SenseRobot"), becoming the world's first A chess robot for the home. As the third chess-playing robot product of Yuanluobo, the new Guoxiang robot has undergone a large number of special technical upgrades and innovations in AI and engineering machinery. For the first time, it has realized the ability to pick up three-dimensional chess pieces through mechanical claws on a home robot, and perform human-machine Functions such as chess playing, everyone playing chess, notation review, etc.

Claude has become lazy too! Netizen: Learn to give yourself a holiday Claude has become lazy too! Netizen: Learn to give yourself a holiday Sep 02, 2024 pm 01:56 PM

The start of school is about to begin, and it’s not just the students who are about to start the new semester who should take care of themselves, but also the large AI models. Some time ago, Reddit was filled with netizens complaining that Claude was getting lazy. "Its level has dropped a lot, it often pauses, and even the output becomes very short. In the first week of release, it could translate a full 4-page document at once, but now it can't even output half a page!" https:// www.reddit.com/r/ClaudeAI/comments/1by8rw8/something_just_feels_wrong_with_claude_in_the/ in a post titled "Totally disappointed with Claude", full of

At the World Robot Conference, this domestic robot carrying 'the hope of future elderly care' was surrounded At the World Robot Conference, this domestic robot carrying 'the hope of future elderly care' was surrounded Aug 22, 2024 pm 10:35 PM

At the World Robot Conference being held in Beijing, the display of humanoid robots has become the absolute focus of the scene. At the Stardust Intelligent booth, the AI ​​robot assistant S1 performed three major performances of dulcimer, martial arts, and calligraphy in one exhibition area, capable of both literary and martial arts. , attracted a large number of professional audiences and media. The elegant playing on the elastic strings allows the S1 to demonstrate fine operation and absolute control with speed, strength and precision. CCTV News conducted a special report on the imitation learning and intelligent control behind "Calligraphy". Company founder Lai Jie explained that behind the silky movements, the hardware side pursues the best force control and the most human-like body indicators (speed, load) etc.), but on the AI ​​side, the real movement data of people is collected, allowing the robot to become stronger when it encounters a strong situation and learn to evolve quickly. And agile

Li Feifei's team proposed ReKep to give robots spatial intelligence and integrate GPT-4o Li Feifei's team proposed ReKep to give robots spatial intelligence and integrate GPT-4o Sep 03, 2024 pm 05:18 PM

Deep integration of vision and robot learning. When two robot hands work together smoothly to fold clothes, pour tea, and pack shoes, coupled with the 1X humanoid robot NEO that has been making headlines recently, you may have a feeling: we seem to be entering the age of robots. In fact, these silky movements are the product of advanced robotic technology + exquisite frame design + multi-modal large models. We know that useful robots often require complex and exquisite interactions with the environment, and the environment can be represented as constraints in the spatial and temporal domains. For example, if you want a robot to pour tea, the robot first needs to grasp the handle of the teapot and keep it upright without spilling the tea, then move it smoothly until the mouth of the pot is aligned with the mouth of the cup, and then tilt the teapot at a certain angle. . this

ACL 2024 Awards Announced: One of the Best Papers on Oracle Deciphering by HuaTech, GloVe Time Test Award ACL 2024 Awards Announced: One of the Best Papers on Oracle Deciphering by HuaTech, GloVe Time Test Award Aug 15, 2024 pm 04:37 PM

At this ACL conference, contributors have gained a lot. The six-day ACL2024 is being held in Bangkok, Thailand. ACL is the top international conference in the field of computational linguistics and natural language processing. It is organized by the International Association for Computational Linguistics and is held annually. ACL has always ranked first in academic influence in the field of NLP, and it is also a CCF-A recommended conference. This year's ACL conference is the 62nd and has received more than 400 cutting-edge works in the field of NLP. Yesterday afternoon, the conference announced the best paper and other awards. This time, there are 7 Best Paper Awards (two unpublished), 1 Best Theme Paper Award, and 35 Outstanding Paper Awards. The conference also awarded 3 Resource Paper Awards (ResourceAward) and Social Impact Award (

Distributed Artificial Intelligence Conference DAI 2024 Call for Papers: Agent Day, Richard Sutton, the father of reinforcement learning, will attend! Yan Shuicheng, Sergey Levine and DeepMind scientists will give keynote speeches Distributed Artificial Intelligence Conference DAI 2024 Call for Papers: Agent Day, Richard Sutton, the father of reinforcement learning, will attend! Yan Shuicheng, Sergey Levine and DeepMind scientists will give keynote speeches Aug 22, 2024 pm 08:02 PM

Conference Introduction With the rapid development of science and technology, artificial intelligence has become an important force in promoting social progress. In this era, we are fortunate to witness and participate in the innovation and application of Distributed Artificial Intelligence (DAI). Distributed artificial intelligence is an important branch of the field of artificial intelligence, which has attracted more and more attention in recent years. Agents based on large language models (LLM) have suddenly emerged. By combining the powerful language understanding and generation capabilities of large models, they have shown great potential in natural language interaction, knowledge reasoning, task planning, etc. AIAgent is taking over the big language model and has become a hot topic in the current AI circle. Au

The first large UI model in China is released! Motiff's large model creates the best assistant for designers and optimizes UI design workflow The first large UI model in China is released! Motiff's large model creates the best assistant for designers and optimizes UI design workflow Aug 19, 2024 pm 04:48 PM

Artificial intelligence is developing faster than you might imagine. Since GPT-4 introduced multimodal technology into the public eye, multimodal large models have entered a stage of rapid development, gradually shifting from pure model research and development to exploration and application in vertical fields, and are deeply integrated with all walks of life. In the field of interface interaction, international technology giants such as Google and Apple have invested in the research and development of large multi-modal UI models, which is regarded as the only way forward for the mobile phone AI revolution. In this context, the first large-scale UI model in China was born. On August 17, at the IXDC2024 International Experience Design Conference, Motiff, a design tool in the AI ​​era, launched its independently developed UI multi-modal model - Motiff Model. This is the world's first UI design tool

AI in use | Trump's soul penetrates 'Black Myth', 3D 'Magic Transformation' Wukong... How many AI gameplays can a black monkey evoke? AI in use | Trump's soul penetrates 'Black Myth', 3D 'Magic Transformation' Wukong... How many AI gameplays can a black monkey evoke? Aug 21, 2024 pm 10:50 PM

Editor of the Machine Power Report: Yang Wen The wave of artificial intelligence represented by large models and AIGC has been quietly changing the way we live and work, but most people still don’t know how to use it. Therefore, we have launched the "AI in Use" column to introduce in detail how to use AI through intuitive, interesting and concise artificial intelligence use cases and stimulate everyone's thinking. We also welcome readers to submit innovative, hands-on use cases. Submission email: content@jiqizhixin.com The screen has been swiped by a black monkey in the past two days. How ridiculously hot is this? Tiktok, Weibo, and official accounts are all chatting about the domestic game "Black Myth: Wukong" with just one swipe. Even the official media has started live broadcasts. There are also companies that directly take holidays so that employees can

See all articles