MediaTek Dimensity 9300 successfully runs a 13 billion parameter AI large model on the device side

On the evening of November 6, MediaTek released its flagship chip Dimensity 9300. According to the official introduction, the Dimensity 9300 has been upgraded to APU 790, which supports 8x speed generative AI Trasformer operator acceleration. It has unique memory hardware compression technology and NeuroPilot Compression mixed precision INT4 quantization technology. At the same time, the integer operation speed is increased by 2 times, and the floating point operation speed is increased by 2 times. Speed ​​increased by 2 times, power consumption reduced by 45%

MediaTek officials stated that they have successfully transplanted the Dimensity 9300 to the terminal device and successfully ran a 7 billion parameter artificial intelligence large language model on the device. In addition, they also successfully ran artificial intelligence large language models with 13 billion parameters and 33 billion parameters

In addition, Dimensity 9300 also supports the generative AI image function, which can generate emoticons

MediaTek also released the "Blue Heart Little V", a tool created in cooperation with vivo. It has been launched at the 2023 vivo Developer Conference and is the "exclusive personal assistant" of OriginOS 4. For more details, please refer to IT House’s previous reports

The above is the detailed content of MediaTek Dimensity 9300 successfully runs a 13 billion parameter AI large model on the device side. For more information, please follow other related articles on the PHP Chinese website!