Any technology is a double-edged sword. What harm may artificial intelligence (AI) bring to us?
Currently, whether scientists, entrepreneurs, media, or others around us, we have been discussing the long-term harm of AI, such as it may cause workers to lose their jobs, surpass or replace human thinking, and even cause humans to lose their interest in civilization. control, etc.
However, the harm that AI brings to us is right in front of us. And, for most people, they don’t know they are a victim until they experience it firsthand.
Recently, the news that "a company boss encountered an AI face-changing scam and was defrauded of 4.3 million yuan in 10 minutes" was once on the hot search list of major news websites. According to the victim, the scammer successfully pretended to be his friend through AI face-changing and onomatopoeia technology, and then defrauded him. “The person who called me made a video call at that time, and I also confirmed the face and voice in the video, so Only then did we relax our guard.”
Although this incident has made people more aware of the "AI face-changing" scam, in fact, there are far more examples of "AI face-changing". Popular celebrities selling goods in live broadcast rooms, some indecent videos The faces in the images, etc., may all be scams created by criminals using AI technology.
In addition, criminals will also use AI technology to extract voice files after stealing other people's WeChat accounts, and commit fraud by forwarding WeChat voices.
The question is, when we enjoy the convenience brought by AI technology, how should we deal with new scams such as "AI face-changing"?
In December last year, the Cyberspace Administration of China, the Ministry of Industry and Information Technology, and the Ministry of Public Security jointly issued the "Regulations on the Management of Deep Synthesis of Internet Information Services", which mentioned: Deep synthesis service providers have strict control over the content generated or edited using their services. Information content should be added with logos that do not affect its use. Services that provide functions that generate or significantly change information content, such as intelligent dialogue, synthesized human voices, face generation, immersive simulated scenes, etc., shall be clearly marked to avoid confusion or misunderstanding by the public.
At the beginning of this month, a short video platform also released the "Platform Specifications and Industry Initiatives on Artificial Intelligence Generated Content", which clearly prohibits the use of generative artificial intelligence technology to create and publish infringing content, including but not limited to portrait rights and intellectual property rights. etc. Once discovered, the platform will severely punish you.
If it involves commercial activities such as live streaming of goods, the face-swapping live broadcast mentioned above may constitute an infringement of the portrait rights of the relevant celebrities and artists, and the situation will be more serious. It should be noted that even if face-swapping live broadcasts are only for entertainment and are not profitable, it is still an infringement without the consent of the portrait rights holder.
So, personally, how should we be wary of new scams such as “AI face-changing”?
On May 24, the Internet Society of China issued a warning, "Faced with new scams that use AI technology, the general public needs to be more vigilant and strengthen prevention!" Specifically, we should be the first person responsible for personal information security, And when transferring funds remotely, be sure to perform multiple verifications and keep your "money bag" in check.
As for the industry, Xiong Zhi, a special commentator of The Paper, believes that regulations must be established as soon as possible to clarify the red line of information protection and strengthen the standardization and guidance of the behavior of technical service providers. Only AI face-changing, AI onomatopoeia, etc. are in every link. Only by having evidence-based and strict authorization and making fraud more difficult can we better protect the security of everyone's information and property.
Finally, if you feel that you are suffering or have suffered from AI face-changing, AI onomatopoeia and other scams, you must learn to use "law" to defeat "AI magic". Of course, the best way to deal with it is to choose not to believe it.
The above is the detailed content of AI fraud is just around the corner, how should we prevent it?. For more information, please follow other related articles on the PHP Chinese website!