Home Technology peripherals AI [Original] Use large models to automatically take notes, extract PPT, and organize interviews. Alibaba Cloud's new AI product 'Tongyi Listening' is open for public testing

[Original] Use large models to automatically take notes, extract PPT, and organize interviews. Alibaba Cloud's new AI product 'Tongyi Listening' is open for public testing

Jun 02, 2023 pm 07:37 PM

Read Chuang/Shenzhen Business Daily reporter Chen Shu

On June 1, Alibaba Cloud announced the progress of the Tongyi large model. The new AI product "Tongyi Listening" focusing on audio and video content was officially launched, becoming the first large model application product in China open to public testing.

【原创】用大模型自动做笔记、提取PPT、整理访谈 阿里云AI新产品“通义听悟”开放公测

Tongyi Tingwu is connected to the understanding and summarization capabilities of Tongyi Qianwen’s large model, and can become a powerful AI assistant for users in work and study, helping to efficiently complete the transcribing, retrieval, summarizing and summarizing of audio and video content anytime and anywhere. Organizing, such as using large models to automatically take notes, organize interviews, extract PPT, etc. During the public beta period, users can receive free transcription time for more than 100 hours of listening comprehension.

"In a different way, audio and video can be easily read, organized and shared." Alibaba Cloud CTO Zhou Jingren introduced that Tingwu is a work-study AI assistant that targets audio and video content scenarios with high added value of knowledge. , such as meetings, classes, interviews, training, interviews, live broadcasts, watching videos, listening to podcasts, etc., can quickly refine and precipitate knowledge through the latest AI technology such as large models.

[caption id="attachment_3846381" align="alignnone" width="1000"]

【原创】用大模型自动做笔记、提取PPT、整理访谈 阿里云AI新产品“通义听悟”开放公测

Tongyi Listening can automatically generate full-text abstracts, chapter summaries, and speech summaries for audio and video[/caption]

Tingwu showed a live demonstration, which included more than a dozen artificial intelligence functions, which can comprehensively improve the efficiency of knowledge transfer from audio and video to graphics and text. In addition to "good hearing", it can generate meeting records with high accuracy and distinguish different speakers. This AI assistant is also "extremely perceptive". The large model can divide audio and video into chapters in one second and form summary, summary and full text of each speaker. Points of view, organization of focus and to-do items. A large model will be launched in the near future, including functions such as one-click extraction of PPT, AI questioning of multiple audio and video contents, and summarizing specific paragraphs.

[caption id="attachment_3846394" align="alignnone" width="736"]

【原创】用大模型自动做笔记、提取PPT、整理访谈 阿里云AI新产品“通义听悟”开放公测

Tongyi Tingwu Chrome plug-in will be available for download to all users in the near future[/caption]

For some niche scenarios, AudioWu has also set up many "treasure functions": open the Chrome plug-in, foreign language learners and hearing-impaired people can use the bilingual floating subtitle bar to watch videos without subtitles anytime and anywhere. When schedule conflicts, listen to Wu can also become a "meeting stand-in" for professionals. The AI ​​can record the meeting and organize key points when the sound is muted. The transcription results can be downloaded as subtitle files to facilitate video post-production by new media practitioners. Review of Q&A organized by Wu It allows reporters, analysts, lawyers, HR and other groups to organize interviews more efficiently.

Tingwu is connected with Alibaba Cloud Disk, and audio and video content on the cloud disk can be transcribed with one click. Tingwu users who registered during the public beta period will also receive larger Alibaba Cloud Disk storage space, and can be online in the cloud disk. Subtitles can also be automatically produced when playing videos.

Zhou Jingren introduced that Tingwu integrates Alibaba’s most advanced voice and language technology. It has built-in Alibaba's new generation industrial-grade speech recognition model, and the recognition accuracy ranks first in multiple authoritative Chinese data sets; it integrates the self-developed speech semantics multi-modal speaker algorithm, and can distinguish roles in scenes where more than 10 people are speaking; After accessing the Tongyi Qianwen large model, it can summarize tens of thousands of words of audio and video content, leading the country in terms of factual accuracy and completeness of key points, and supports accurate question and answer understanding across multiple audio and video contents.

Reviewer: Tan Lugang

The above is the detailed content of [Original] Use large models to automatically take notes, extract PPT, and organize interviews. Alibaba Cloud's new AI product 'Tongyi Listening' is open for public testing. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Best AI Art Generators (Free & Paid) for Creative Projects Best AI Art Generators (Free & Paid) for Creative Projects Apr 02, 2025 pm 06:10 PM

The article reviews top AI art generators, discussing their features, suitability for creative projects, and value. It highlights Midjourney as the best value for professionals and recommends DALL-E 2 for high-quality, customizable art.

Getting Started With Meta Llama 3.2 - Analytics Vidhya Getting Started With Meta Llama 3.2 - Analytics Vidhya Apr 11, 2025 pm 12:04 PM

Meta's Llama 3.2: A Leap Forward in Multimodal and Mobile AI Meta recently unveiled Llama 3.2, a significant advancement in AI featuring powerful vision capabilities and lightweight text models optimized for mobile devices. Building on the success o

Best AI Chatbots Compared (ChatGPT, Gemini, Claude & More) Best AI Chatbots Compared (ChatGPT, Gemini, Claude & More) Apr 02, 2025 pm 06:09 PM

The article compares top AI chatbots like ChatGPT, Gemini, and Claude, focusing on their unique features, customization options, and performance in natural language processing and reliability.

Is ChatGPT 4 O available? Is ChatGPT 4 O available? Mar 28, 2025 pm 05:29 PM

ChatGPT 4 is currently available and widely used, demonstrating significant improvements in understanding context and generating coherent responses compared to its predecessors like ChatGPT 3.5. Future developments may include more personalized interactions and real-time data processing capabilities, further enhancing its potential for various applications.

Top AI Writing Assistants to Boost Your Content Creation Top AI Writing Assistants to Boost Your Content Creation Apr 02, 2025 pm 06:11 PM

The article discusses top AI writing assistants like Grammarly, Jasper, Copy.ai, Writesonic, and Rytr, focusing on their unique features for content creation. It argues that Jasper excels in SEO optimization, while AI tools help maintain tone consist

Choosing the Best AI Voice Generator: Top Options Reviewed Choosing the Best AI Voice Generator: Top Options Reviewed Apr 02, 2025 pm 06:12 PM

The article reviews top AI voice generators like Google Cloud, Amazon Polly, Microsoft Azure, IBM Watson, and Descript, focusing on their features, voice quality, and suitability for different needs.

Top 7 Agentic RAG System to Build AI Agents Top 7 Agentic RAG System to Build AI Agents Mar 31, 2025 pm 04:25 PM

2024 witnessed a shift from simply using LLMs for content generation to understanding their inner workings. This exploration led to the discovery of AI Agents – autonomous systems handling tasks and decisions with minimal human intervention. Buildin

AV Bytes: Meta's Llama 3.2, Google's Gemini 1.5, and More AV Bytes: Meta's Llama 3.2, Google's Gemini 1.5, and More Apr 11, 2025 pm 12:01 PM

This week's AI landscape: A whirlwind of advancements, ethical considerations, and regulatory debates. Major players like OpenAI, Google, Meta, and Microsoft have unleashed a torrent of updates, from groundbreaking new models to crucial shifts in le

See all articles