Leading Android again! Apple's artificial intelligence research has made significant progress: it will completely change your iPhone
Quick Technology News on December 22, according to VB reports, two papers recently published by Apple demonstrate the significant progress the company has made in artificial intelligence research.
Among them, an efficient new language model inference technology is expected to allow complex AI systems to run smoothly on small memory devices such as iPhones and iPads.
In a paper, Apple researchers address a key challenge in deploying large language models (LLM) on devices with limited memory.
As we all know, large models like GPT-4 contain the first 100 billion parameters. If run directly on consumer hardware, the cost of inference will be very high.
It is reported that Apple technicians minimized the data transfer from flash memory to memory during inference. A series of methods improves inference latency by 4-5 times. On GPU, the acceleration reaches 20-25 times.
This breakthrough is particularly important for deploying advanced LLM in resource-limited environments, greatly improving applicability and accessibility.
What this means for Apple users, These optimizations may soon allow sophisticated artificial intelligence assistants and chatbots to run smoothly on iPhones, iPads, and other mobile devices.
Previously, Tianfeng International Securities analyst Ming-Chi Kuo recently published a post stating that iPhone 16 will launch AI-related innovative features.
It is reported that Apple reorganized the Siri team in the third quarter of this year, with the goal of integrating AIGC functions and LLM (Large Language Model).
On mobile phones, voice input will be the key interface for AI, AIGC, and LLM (large language model), so strengthening Siri’s software functions is the key to promoting AI functions.
Kuo Ming-Chi’s latest survey shows that all iPhone 16 models will significantly upgrade microphone specifications. In addition to better waterproofing, they also have better signal-to-noise ratio to improve the Siri experience.
The above is the detailed content of Apple's artificial intelligence research will bring revolutionary changes and enhance iPhone's leading edge. For more information, please follow other related articles on the PHP Chinese website!