Home Technology peripherals AI Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface

Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface

Nov 28, 2023 pm 08:27 PM

Professor Mohammed Sawan’s team at the Advanced Neural Chip Center, Professor Zhang Yue’s team and Professor Zhu Junming’s team from the Natural Language Processing Laboratory jointly released their latest research results: “A high-performance brain-sentence communication designed for logosyllabic language". This research realizes full-spectrum Chinese decoding of brain-computer interface, which to a certain extent fills the gap in international Chinese decoding brain-computer interface technology.

Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface

Brain-computer interface (BCI) is recognized as the main battlefield for the cross-integration of life sciences and information technology in the future, and is a research direction with important social value and strategic significance.

Brain-computer interface technology refers to the creation of a connection path for information exchange between the human or animal brain and external devices. Its essence is a new type of information transmission channel that allows information to bypass the original muscle and peripheral nerve pathways. Realize connection with the external world, thereby replacing human movement, language and other functions to a certain extent.

Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface Design and performance of full-spectrum Chinese decoder for brain-computer interface

In August of this year, two back-to-back Nature articles demonstrated the power of brain-computer interfaces in language recovery. However, most of the existing language brain-computer interface technologies are built for alphabetic language systems such as English, and research on language brain-computer interface systems for non-alphabetic systems such as Chinese characters is still blank.

In this study, the research team used stereotactic electroencephalography (SEEG) to collect neural activity signals in the brain corresponding to the pronunciation process of all Mandarin Chinese characters, and combined with deep learning algorithms and language models to achieve full-spectrum pronunciation of Chinese characters. Decoding, establishing a Chinese brain-computer interface system covering the pronunciation of all Chinese Mandarin characters, achieving end-to-end output from brain activity to complete Mandarin sentences.

Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface

Chinese, as a pictographic and syllabic language, has more than 50,000 characters, which is significantly different from English, which is composed of 26 letters, so this is a huge challenge for existing language brain-computer interface systems. challenges. In order to solve this problem, over the past three years, the research team has conducted an in-depth analysis of the pronunciation rules and characteristics of the Chinese language itself. Starting from the three elements of initial consonants, tones and finals of Chinese pronunciation syllables, and combining the characteristics of the Pinyin input system, a new language brain-computer interface system suitable for Chinese was designed. The research team built a Chinese speech-SEEG database of more than 100 hours by designing a speech database covering all 407 Chinese Pinyin syllables and Chinese pronunciation characteristics and simultaneously collecting EEG signals. Through artificial intelligence model training, the system built a prediction model for the three elements of Chinese character pronunciation syllables (including initial consonants, tones and finals), and finally integrated all predicted elements through a language model, combining semantic information to generate the most likely Complete Chinese sentences.

Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface

The research team evaluated the decoding ability of this brain-computer interface system in a simulated daily Chinese environment. After more than 100 randomly selected complex communication scene decoding tests of 2 to 15 characters, the median character error rate of all participants averaged only 29%, and some participants obtained completely correct sentences through EEG decoding. reached 30%. The relatively efficient decoding performance is due to the excellent performance of the three independent syllable element decoders and the perfect cooperation of the intelligent language model. In particular, in terms of classifying 21 initial consonants, the accuracy of the initial consonant decoder exceeds 40% (more than 3 times the baseline), and the Top 3 accuracy rate reaches almost 100%; while the tone decoder used to distinguish 4 tones The accuracy rate also reached 50% (more than 2 times the baseline). In addition to the outstanding contributions of the three independent syllable element decoders, the powerful automatic error correction and context connection capabilities of the intelligent language model also make the performance of the entire language brain-computer interface system even more outstanding.

This research provides a new perspective for the study of BCI decoding of Chinese, a phonetic language, and also proves that the performance of language brain-computer interface systems can be significantly improved through powerful language models, laying the foundation for future phonetic language neural prostheses. Research provides new directions. This work also indicates that patients with neurological diseases will soon be able to control computer-generated Chinese sentences through their thoughts and regain the ability to communicate!

Reference content

https://www.biorxiv.org/content/10.1101/2023.11.05.562313v1.full.pdf

The above is the detailed content of Important breakthrough! The Westlake University team and Zhejiang Second Hospital jointly realized Chinese decoding of brain-computer interface. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
1 months ago By 尊渡假赌尊渡假赌尊渡假赌
Two Point Museum: All Exhibits And Where To Find Them
1 months ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

I Tried Vibe Coding with Cursor AI and It's Amazing! I Tried Vibe Coding with Cursor AI and It's Amazing! Mar 20, 2025 pm 03:34 PM

Vibe coding is reshaping the world of software development by letting us create applications using natural language instead of endless lines of code. Inspired by visionaries like Andrej Karpathy, this innovative approach lets dev

How to Use YOLO v12 for Object Detection? How to Use YOLO v12 for Object Detection? Mar 22, 2025 am 11:07 AM

YOLO (You Only Look Once) has been a leading real-time object detection framework, with each iteration improving upon the previous versions. The latest version YOLO v12 introduces advancements that significantly enhance accuracy

How to Use DALL-E 3: Tips, Examples, and Features How to Use DALL-E 3: Tips, Examples, and Features Mar 09, 2025 pm 01:00 PM

DALL-E 3: A Generative AI Image Creation Tool Generative AI is revolutionizing content creation, and DALL-E 3, OpenAI's latest image generation model, is at the forefront. Released in October 2023, it builds upon its predecessors, DALL-E and DALL-E 2

Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More! Top 5 GenAI Launches of February 2025: GPT-4.5, Grok-3 & More! Mar 22, 2025 am 10:58 AM

February 2025 has been yet another game-changing month for generative AI, bringing us some of the most anticipated model upgrades and groundbreaking new features. From xAI’s Grok 3 and Anthropic’s Claude 3.7 Sonnet, to OpenAI’s G

Elon Musk & Sam Altman Clash over $500 Billion Stargate Project Elon Musk & Sam Altman Clash over $500 Billion Stargate Project Mar 08, 2025 am 11:15 AM

The $500 billion Stargate AI project, backed by tech giants like OpenAI, SoftBank, Oracle, and Nvidia, and supported by the U.S. government, aims to solidify American AI leadership. This ambitious undertaking promises a future shaped by AI advanceme

Google's GenCast: Weather Forecasting With GenCast Mini Demo Google's GenCast: Weather Forecasting With GenCast Mini Demo Mar 16, 2025 pm 01:46 PM

Google DeepMind's GenCast: A Revolutionary AI for Weather Forecasting Weather forecasting has undergone a dramatic transformation, moving from rudimentary observations to sophisticated AI-powered predictions. Google DeepMind's GenCast, a groundbreak

Sora vs Veo 2: Which One Creates More Realistic Videos? Sora vs Veo 2: Which One Creates More Realistic Videos? Mar 10, 2025 pm 12:22 PM

Google's Veo 2 and OpenAI's Sora: Which AI video generator reigns supreme? Both platforms generate impressive AI videos, but their strengths lie in different areas. This comparison, using various prompts, reveals which tool best suits your needs. T

Which AI is better than ChatGPT? Which AI is better than ChatGPT? Mar 18, 2025 pm 06:05 PM

The article discusses AI models surpassing ChatGPT, like LaMDA, LLaMA, and Grok, highlighting their advantages in accuracy, understanding, and industry impact.(159 characters)

See all articles