'AI face-changing' software is publicly sold online, ranging from a few hundred to a thousand yuan! Where are the legal boundaries?

This article is reproduced from [CCTV News];

Recently, fraud cases caused by "AI face-changing" have attracted attention. With the development of large AI models, the application scope of "face-swapping technology" is getting wider and wider. Technological breakthroughs have also made the facial expressions and action details of the characters after face-swapping more realistic. Once used by criminals, it may cause serious harm. .

The reporter from the main station found after investigation that "AI face-changing" software is very easy to obtain on the Internet. Where are the legal boundaries for exploiting such software? How to do a good job in advance supervision?

“AI face-changing” appeared on the InternetPaidSoftware

Package prices range from 499 yuan to 2888 yuan

On the Internet, there are many tutorials demonstrating the use and effects of face-changing software. Many of these "AI face-changing" software require high-priced payment to use.

The reporter contacted a developer based on the search results, and he provided the reporter with a demonstration video of using his software to implement face-changing. The left side of the dual-window page is the original video before the face-changing, and the right side is after the face-changing. ’s video, to the naked eye, the mouth shape, expressions, and tiny movements of the “digital human” after face replacement are almost flawless.

On its sales website, the software developer also demonstrated how to "splice" the eyes and mouths of two well-known actresses together to generate a video of a new "digital human".

This paid software provides different versions, from LV1 (junior) to LV4 (super), and then to LV5 (full functions). For the entry-level package, 499 yuan provides software interface, video guidance, face-swapping models, etc. If you spend 2,888 yuan, you can get a full set of (LV5) video face-swapping models.

"You can change any face you want"

AI large model can integrate multiple functions to create a “digital human” The reporter found that there was no text at the bottom of the website indicating that it had been registered. The seller is also very cautious and only communicates through text throughout the process. He said that compared with the junior (LV1) to super (LV4) packages, the full (LV5) version has more iterations and stronger capabilities. It can also be understood that the face-changing effect is more realistic. At the same time, it can not only achieve video face-changing, It also supports live face-changing.

When the reporter further asked whether the face could be changed according to his own needs, the software developer said: "You can just use the materials and train on whatever face you want to change."

According to a technician engaged in artificial intelligence development, this means that there may be more risks that are difficult to manage. "Integrating Vincent pictures, Vincent texts, Vincent audio, Vincent videos, and face-changing. When these functions are combined, a completely new 'digital human' or 'AI human' can be created. The cost and difficulty of supervision are several times higher." Magnitude. "

Expert: Effective labeling supervision system

Be able to clarify in advance the blurred boundaries caused by "AI face-changing"‍

Zhao Zhanzhan, a lawyer at Beijing Jiawei Law Firm and an IT law expert, said that from the perspective of post-attack, the criminal law has provisions on the crime of fraud; the civil code clearly states that citizens enjoy corresponding rights such as portrait rights, name rights, and reputation rights. civil rights. In other words, if there is a case of using someone else's image to commit fraud, the criminals will be subject to legal sanctions and restrictions. However, with the rapid development of artificial intelligence technology, we should also explore how to achieve effective prevention in advance.

For example, the "Provisions on the Management of Deep Synthesis of Internet Information Services" requires that if the deep synthesis service may cause public confusion or misunderstanding, the deep synthesis service provider shall prominently display the information in a reasonable location and area of ​​the generated or edited information content. logo.

The "Measures for the Management of Generative Artificial Intelligence Services (Draft for Comments)" requires that before using generative artificial intelligence products to provide services to the public, a security assessment must be reported to the national cybersecurity and informatization department in accordance with relevant regulations; the legitimate interests of others must be respected; Product providers should be responsible for the legality of pre-training data and optimized training data sources for generative artificial intelligence products.

Pan Helin, co-director of the Digital Economy and Financial Innovation Research Center of the International Joint Business School of Zhejiang University, believes that for now, if the requirements for labeling can be effectively implemented and an effective regulatory system can be formed, clarification can be clarified in advance to a large extent. The blurred boundaries brought about by “AI face-changing”.

Pan Helin: The current labeling supervision system for "AI face-changing" has not yet been formed. Unlabeled content must be identified through technical means, and specific penalties must be imposed on individuals or organizations that do not label. Measures, standards and systems.

Zhao Zhanzhan, a lawyer at Beijing Jiawei Law Firm and an IT legal expert, believes that In the long run, supervision and punishment measures need to be continuously "iterated" with technological development to form a three-dimensional and effective governance plan.

The above is the detailed content of 'AI face-changing' software is publicly sold online, ranging from a few hundred to a thousand yuan! Where are the legal boundaries?. For more information, please follow other related articles on the PHP Chinese website!