Home Technology peripherals AI Meta open source AI language model MusicGen can convert text and melodies into complete music

Meta open source AI language model MusicGen can convert text and melodies into complete music

Jun 13, 2023 am 11:39 AM

IT House News on June 12, Meta recently open sourced its AI language model MusicGen on Github, which is based on the Transformer model launched by Google in 2017. As the name of the model indicates, MusicGen is mainly used for music generation. It can convert text and existing melodies into complete music.

Meta 开源 AI 语言模型 MusicGen,可将文本和旋律转化为完整乐曲

The R&D team stated: “We used 20,000 hours of authorized music to train the model, and used Meta’s EnCodec encoder to decompose the audio data into smaller units for parallel processing, thereby improving MusicGen’s computing efficiency and generation The speed is better than the same type of AI model.”

In addition, MusicGen also supports the combined input of text and melody. For example, you can propose to generate "a light track" and at the same time request "to combine it with Beethoven's "Ode to Joy" Combined".

The R&D team also tested the actual performance of MusicGen. The results show that compared with Google's MusicLM and other music models such as Riffusion, Mousai, and Noise2Music, MusicGen performs better in testing indicators such as the matching of music and text prompts and the credibility of the composition, and is overall slightly higher than Google's MusicLM level.

Meta has allowed commercial use of the model and has released a demo web application on Huggingface.

IT Home attaches the model address: Click here to go

Demo application address: Click here to go

The above is the detailed content of Meta open source AI language model MusicGen can convert text and melodies into complete music. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot Article Tags

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

What is Model Context Protocol (MCP)? What is Model Context Protocol (MCP)? Mar 03, 2025 pm 07:09 PM

What is Model Context Protocol (MCP)?

Building a Local Vision Agent using OmniParser V2 and OmniTool Building a Local Vision Agent using OmniParser V2 and OmniTool Mar 03, 2025 pm 07:08 PM

Building a Local Vision Agent using OmniParser V2 and OmniTool

Replit Agent: A Guide With Practical Examples Replit Agent: A Guide With Practical Examples Mar 04, 2025 am 10:52 AM

Replit Agent: A Guide With Practical Examples

Runway Act-One Guide: I Filmed Myself to Test It Runway Act-One Guide: I Filmed Myself to Test It Mar 03, 2025 am 09:42 AM

Runway Act-One Guide: I Filmed Myself to Test It

Elon Musk & Sam Altman Clash over $500 Billion Stargate Project Elon Musk & Sam Altman Clash over $500 Billion Stargate Project Mar 08, 2025 am 11:15 AM

Elon Musk & Sam Altman Clash over $500 Billion Stargate Project

DeepSeek Releases 3FS & Smallpond Framework DeepSeek Releases 3FS & Smallpond Framework Mar 03, 2025 pm 07:07 PM

DeepSeek Releases 3FS & Smallpond Framework

5 Grok 3 Prompts that Can Make Your Work Easy 5 Grok 3 Prompts that Can Make Your Work Easy Mar 04, 2025 am 10:54 AM

5 Grok 3 Prompts that Can Make Your Work Easy

I Tried Vibe Coding with Cursor AI and It's Amazing! I Tried Vibe Coding with Cursor AI and It's Amazing! Mar 20, 2025 pm 03:34 PM

I Tried Vibe Coding with Cursor AI and It's Amazing!

See all articles