Home > Technology peripherals > AI > Microsoft releases VALL-E, an AI voice generation tool that can imitate human speech in just 3 seconds of audio

Microsoft releases VALL-E, an AI voice generation tool that can imitate human speech in just 3 seconds of audio

PHPz
Release: 2023-05-10 09:13:36
forward
2126 people have browsed it

微软发布 AI 声音生成工具 VALL-E,只需 3 秒音频即可模仿人说话

News on January 10th, Microsoft recently released an artificial intelligence tool called VALL-E that can imitate human speech in just 3 seconds of audio.

The tool is trained on 60,000 hours of English speech data and uses 3-second clips of specific speech to generate content. Unlike many current AI tools, VALL-E can replicate a speaker's mood and tone, even in words the speaker himself has never spoken.

微软发布 AI 声音生成工具 VALL-E,只需 3 秒音频即可模仿人说话

IT House learned that a paper from Cornell University used VALL-E to synthesize several sounds. You can listen to it on GitHub These AI-synthesized audios​​.

The researchers noted that in many cases, Vall-E outperformed current text-to-speech models. However, the study also writes that AI models currently have several problems. For example, some words in a text prompt might be unclearly pronounced, missing entirely, or appear twice in the output. Additionally, the model currently has difficulty imitating certain voices, especially those with accents.

Like other new AI technologies, VALL-E has also raised concerns in terms of safety and ethics. Microsoft issued an ethics statement about the use of VALL-E, but it was unclear about its future use.

Currently, Microsoft Vall-E has not yet been open sourced. Microsoft has created a ​

​Vall-E repository​​ on GitHub, but it currently only contains a description file.

The above is the detailed content of Microsoft releases VALL-E, an AI voice generation tool that can imitate human speech in just 3 seconds of audio. For more information, please follow other related articles on the PHP Chinese website!

Related labels:
source:51cto.com
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template