MediaTek uses Meta Llama 2 language model to enhance the capabilities of end device generative AI applications

On August 24, 2023, MediaTek announced the use of Meta’s new generation open source large language model (LLM) Llama 2 as well as MediaTek’s advanced AI processor (APU) and complete AI development platform (NeuroPilot). A complete terminal-side AI computing ecosystem has been established to accelerate the development of AI applications for smartphones, IoT, automobiles, smart homes and other edge devices, providing a safer, more reliable and differentiated user experience for terminal devices. It is expected that by the end of the year, smartphones powered by MediaTek's new-generation Dimensity flagship mobile chip will support AI applications developed by the Llama 2 model, bringing users an exciting generative AI application experience

Dr. Xu Jingquan, Senior Deputy General Manager of MediaTek and General Manager of the Wireless Communications Division, said: "The popularization of generative artificial intelligence is one of the important trends in digital transformation. Our vision is to provide Llama 2 developers and end users with Provide tools to bring more exciting artificial intelligence innovation opportunities and product experiences. Through its partnership with Meta, MediaTek can provide more powerful overall hardware and software solutions, bringing far more benefits to terminal devices than ever before. Functionality and experience.”

Currently, most generative AI relies on cloud computing to run. However, through the successful application of the Llama 2 model, MediaTek has realized the function of running generative AI applications directly on terminal devices. The emergence of this technology brings unique advantages to developers and users. First of all, users can enjoy a seamless user experience while also gaining stronger user information security and reliability. Secondly, this technology can achieve lower latency and have the ability to perform offline operations. In addition, this technology can also reduce operating costs compared to relying on cloud computing. In short, through MediaTek’s innovation, everyone can easily enjoy the convenience and innovation brought by generative AI

In order to fully unleash the potential of generative AI, terminal device manufacturers need to adopt high-computing power, low-power consumption AI processors (APUs) and enhance the overall computing power of the device through faster and more reliable network connections. . Currently, every MediaTek 5G smartphone SoC is equipped with an AI processor, which has been successfully used in generative AI applications, such as AI noise reduction (AI-NR), AI super resolution (AI-SR) and AI motion compensation ( AI-MEMC) etc

MediaTek plans to launch a new generation of flagship mobile chips by the end of the year. The chip will use a software stack (NeuroPilot) optimized for the Llama 2 model, and will be equipped with an upgraded AI processor (APU) to support the Transformer model as the backbone network acceleration. This design can reduce the read and write consumption and bandwidth usage of dynamic random access memory (DRAM), and further improve the performance of large language models and generative AI applications. This will help developers create amazing AI applications and accelerate the implementation and development of AI applications on terminal devices

The above is the detailed content of MediaTek uses Meta Llama 2 language model to enhance the capabilities of end device generative AI applications. For more information, please follow other related articles on the PHP Chinese website!