Volcano Engine's ultra-clear restoration of Beyond's classic concert, technical capabilities have been made available to the public

On the evening of July 3rd, Douyin joined hands with Universal Music’s label PolyGram to live broadcast the selected content of the Beyond Live 1991 life contact concert and commemorative concert that had been restored by Volcano Engine ultra-clear, attracting more than 1.4 100 million views.

Beyond is a rock band founded in 1983. With the rise of Cantonese music, the name of the Beyond band has become a cultural imprint of an era. "Beyond Live 1991" was the first concert held by Beyond at the Hung Hom Stadium. The DVDs subsequently released by PolyGram were almost hard to find in the 1990s. In the 31 years since then, this concert has become the musical enlightenment and youthful memory of generations of fans.

Limited by the shooting equipment, storage media and recording equipment technology at the time, the quality of the concert master tapes and various versions of audio and video circulated on the Internet was poor. In order to improve the viewing and listening experience and reproduce the classic Beyond, the Volcano Engine has been restored in terms of image quality and sound quality.

According to the Volcano Engine Multimedia Laboratory, early software and hardware equipment were backward, resulting in problems such as blurry images, texture loss, and noise defects during the production, compression, and transmission of films. Improving the image quality while restoring as much detail as possible, optimizing colors and retaining a retro feel, and adjusting the restoration effects of portraits of different sizes and postures are the difficulties of this restoration.

"Our goal is to improve the picture quality in terms of overall picture clarity, restoration of facial features, color brightness, fluency, and aesthetics." In terms of picture quality, this book The second repair uses algorithms such as clarity enhancement, defect repair, and regional color brightness enhancement to deal with problems caused by backward software and hardware equipment in the early stage. The video resolution has been increased from less than 540p to close to 4K level, and the frame rate has been increased from 25fps to 60fps.

Through the portrait enhancement algorithm, the eyeliner, pores and other details on Huang Jiaju’s face are clearly visible

In addition, the Volcano Engine Multimedia Laboratory also develops self-adaptive portrait enhancement algorithms to repair and enhance problems such as facial compression damage, blur, and low resolution. This technology is based on deep learning, which not only eliminates the blurring and compression damage of the entire face, but also further reconstructs the key features of the face in detail. After repair, the beard and pores on the character's face are clearly visible, giving the audience a better visual experience.

In terms of sound quality repair, the Volcano Engine audio technology team uses audio noise reduction, audio super-resolution and loudness algorithms to eliminate noise, improve sound quality, and solve problems such as loudness, noise interference, and insufficient bandwidth.

Different from traditional noise reduction solutions, this noise reduction algorithm implements a compatible AI noise reduction algorithm for music scenes and vocal scenes. On the premise of retaining music and vocals, Suppress ambient noise. The audio super-resolution algorithm expands the frequency band of the vocal part in the concert, enriches the high-frequency information, and makes the vocals clearer. It can be seen from the spectrogram that through the processing of the super-resolution module, the high-frequency part of the original audio has been expanded and enhanced.

Through the processing of the audio super-resolution algorithm, the original audio is greater than 12kHz The audio information has been completed and repaired to a certain extent

Due to the different sound pickup conditions in the concert, the singing voice in the concert is sometimes too small compared to the sound of musical instruments and ambient sounds. , the Volcano Engine audio technology team uses the loudness algorithm to first extract the singing part separately, then adjust the loudness of the singing part, and finally mix it to make the overall human voice more comfortable.

It is understood that these restoration capabilities of the concert have been provided to the outside world through the Volcano Engine intelligent processing and audio technology products. In addition, Volcano Engine has also opened up to the outside world a full-link end-to-end solution for image quality, covering uploading, transcoding, transmission, consumption and other links to achieve all-round optimization of video content in terms of image quality, bit rate, and experience.

Digital technology is becoming a force driving cultural inheritance. Relevant reports show that in October 2021, Xigua Video and Volcano Engine launched the "Classic Video 4K Restoration Plan". Through technical means, a total of 71 classic cartoons have been restored. The restored content can be downloaded for free on Xigua Video and Fresh Time TV Watch.

The person in charge of Volcano Engine said that in the future, more advanced technologies will be used to restore classic images and give them a new lease of life.

The above is the detailed content of Volcano Engine's ultra-clear restoration of Beyond's classic concert, technical capabilities have been made available to the public. For more information, please follow other related articles on the PHP Chinese website!