Home Technology peripherals AI Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones

Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones

Apr 24, 2024 pm 01:55 PM
Microsoft industry phi-3

Data has become the focus of improving the capabilities of large models.

## Not long after Llama-3 was released, competitors came, and they were small models that could be run on mobile phones. .

#On Tuesday, Microsoft released its self-developed small-size model Phi-3.

The new model has three versions, among which Phi-3 mini is a language model with 3.8 billion parameters. After training with 3.3 trillion tokens, its overall performance is on academic benchmarks and excellent results in internal tests.

Although Phi-3 mini is optimized to be deployed on mobile phones, its performance is comparable to models such as Mixtral 8x7B and GPT-3.5. Microsoft said the innovation lies primarily in the data sets used for training.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
At the same time, Phi-3 uses the same architecture as Llama-2, making it easier for the open source community to develop on its basis.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Previously, Microsoft's Phi series models have aroused heated discussions. In June last year, Microsoft released the paper "Textbooks Are All You Need", with a scale of only The "textbook quality" data of 7B tokens trained the model phi-1 with 1.3B parameters and achieved good performance.

Last September, Microsoft further explored this path, allowing the 1.3B parameter Transformer architecture language model Phi-1.5 to show powerful coding capabilities.

At the end of last year, Phi-2 proposed by Microsoft has certain common sense capabilities, and its multiple benchmark test results exceeded Llama2 7B, Llama2 13B, and Llama2 13B in the order of 2.7B. Mistral 7B and other advanced models.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Phi-3 Technical Report: https://arxiv.org/abs/2404.14219

Just proposed phi-3-mini is a 3.8 billion parameter language model trained on 3.3 trillion tokens. Experimental tests show that the overall performance of phi-3-mini is comparable to models such as Mixtral 8x7B and GPT-3.5. For example, phi-3-mini reaches 69% on MMLU and 8.38 on MT-bench.

Microsoft's previous research on the phi series of models has shown that high-quality "small data" can enable smaller models to achieve good performance. phi-3-mini is trained on heavily filtered network data and synthetic data (similar to phi-2) and further tuned for robustness, security, and chat format.

In addition, the research team also provides the initial parameter expansion results of the 7B and 14B models trained for 4.8T tokens, called phi-3-small and phi-3- medium, both are more capable than phi-3-mini.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Academic Benchmarks

In standard open source benchmarks, phi-3-mini The comparison results with phi-2, Mistral-7b-v0.1, Mixtral-8x7B, Gemma 7B, Llama-3-instruct8B and GPT-3.5 are shown in the table below. To ensure comparability, all results are passed exactly The pipeline is obtained.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Security

Phi-3-mini is based on Microsoft Responsible Artificial Intelligence developed in principle. The overall approach to securing large models includes post-training security tuning, red-teaming testing, automated testing, and assessment of dozens of RAI hazard categories. Microsoft leverages a modified useful and harmless preference dataset [BJN 22, JLD 23] inspired by [BSA 24] and multiple internally generated datasets to address RAI hazard categories for security post-training. An independent red team at Microsoft re-examined phi-3-mini to further identify areas for improvement in the post-training process.

Based on the feedback from the red team, the research team compiled additional data sets to improve the post-training data set. This process resulted in a significant reduction in deleterious response rates, as shown in Figure 3 .
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
The following table shows the relationship between phi-3-mini-4k and phi-3-mini-128k and phi-2, Mistral-7B-v0.1, Gemma 7B Internal multi-turn dialogue RAI benchmark results.This benchmark leverages GPT-4 to simulate multiple rounds of conversations across five different categories and evaluate model responses.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Defects

##Microsoft stated that in terms of LLM capabilities, although phi-3 -The mini model achieves similar levels of language understanding and reasoning capabilities as larger models, but it is still fundamentally limited by its size on some tasks. For example, the model simply doesn’t have the ability to store much “factual knowledge,” which can be seen in the low rating on TriviaQA. However, researchers believe these issues can be addressed through search engine enhancements.
Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones
Reference content: https://news.ycombinator.com/item?id= 40127806

The above is the detailed content of Microsoft releases Phi-3, which has superior performance to Llama-3 and can be run on mobile phones. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

DeepMind robot plays table tennis, and its forehand and backhand slip into the air, completely defeating human beginners DeepMind robot plays table tennis, and its forehand and backhand slip into the air, completely defeating human beginners Aug 09, 2024 pm 04:01 PM

But maybe he can’t defeat the old man in the park? The Paris Olympic Games are in full swing, and table tennis has attracted much attention. At the same time, robots have also made new breakthroughs in playing table tennis. Just now, DeepMind proposed the first learning robot agent that can reach the level of human amateur players in competitive table tennis. Paper address: https://arxiv.org/pdf/2408.03906 How good is the DeepMind robot at playing table tennis? Probably on par with human amateur players: both forehand and backhand: the opponent uses a variety of playing styles, and the robot can also withstand: receiving serves with different spins: However, the intensity of the game does not seem to be as intense as the old man in the park. For robots, table tennis

Microsoft releases Win11 August cumulative update: improving security, optimizing lock screen, etc. Microsoft releases Win11 August cumulative update: improving security, optimizing lock screen, etc. Aug 14, 2024 am 10:39 AM

According to news from this site on August 14, during today’s August Patch Tuesday event day, Microsoft released cumulative updates for Windows 11 systems, including the KB5041585 update for 22H2 and 23H2, and the KB5041592 update for 21H2. After the above-mentioned equipment is installed with the August cumulative update, the version number changes attached to this site are as follows: After the installation of the 21H2 equipment, the version number increased to Build22000.314722H2. After the installation of the equipment, the version number increased to Build22621.403723H2. After the installation of the equipment, the version number increased to Build22631.4037. The main contents of the KB5041585 update for Windows 1121H2 are as follows: Improvement: Improved

The first mechanical claw! Yuanluobao appeared at the 2024 World Robot Conference and released the first chess robot that can enter the home The first mechanical claw! Yuanluobao appeared at the 2024 World Robot Conference and released the first chess robot that can enter the home Aug 21, 2024 pm 07:33 PM

On August 21, the 2024 World Robot Conference was grandly held in Beijing. SenseTime's home robot brand "Yuanluobot SenseRobot" has unveiled its entire family of products, and recently released the Yuanluobot AI chess-playing robot - Chess Professional Edition (hereinafter referred to as "Yuanluobot SenseRobot"), becoming the world's first A chess robot for the home. As the third chess-playing robot product of Yuanluobo, the new Guoxiang robot has undergone a large number of special technical upgrades and innovations in AI and engineering machinery. For the first time, it has realized the ability to pick up three-dimensional chess pieces through mechanical claws on a home robot, and perform human-machine Functions such as chess playing, everyone playing chess, notation review, etc.

Claude has become lazy too! Netizen: Learn to give yourself a holiday Claude has become lazy too! Netizen: Learn to give yourself a holiday Sep 02, 2024 pm 01:56 PM

The start of school is about to begin, and it’s not just the students who are about to start the new semester who should take care of themselves, but also the large AI models. Some time ago, Reddit was filled with netizens complaining that Claude was getting lazy. "Its level has dropped a lot, it often pauses, and even the output becomes very short. In the first week of release, it could translate a full 4-page document at once, but now it can't even output half a page!" https:// www.reddit.com/r/ClaudeAI/comments/1by8rw8/something_just_feels_wrong_with_claude_in_the/ in a post titled "Totally disappointed with Claude", full of

At the World Robot Conference, this domestic robot carrying 'the hope of future elderly care' was surrounded At the World Robot Conference, this domestic robot carrying 'the hope of future elderly care' was surrounded Aug 22, 2024 pm 10:35 PM

At the World Robot Conference being held in Beijing, the display of humanoid robots has become the absolute focus of the scene. At the Stardust Intelligent booth, the AI ​​robot assistant S1 performed three major performances of dulcimer, martial arts, and calligraphy in one exhibition area, capable of both literary and martial arts. , attracted a large number of professional audiences and media. The elegant playing on the elastic strings allows the S1 to demonstrate fine operation and absolute control with speed, strength and precision. CCTV News conducted a special report on the imitation learning and intelligent control behind "Calligraphy". Company founder Lai Jie explained that behind the silky movements, the hardware side pursues the best force control and the most human-like body indicators (speed, load) etc.), but on the AI ​​side, the real movement data of people is collected, allowing the robot to become stronger when it encounters a strong situation and learn to evolve quickly. And agile

Li Feifei's team proposed ReKep to give robots spatial intelligence and integrate GPT-4o Li Feifei's team proposed ReKep to give robots spatial intelligence and integrate GPT-4o Sep 03, 2024 pm 05:18 PM

Deep integration of vision and robot learning. When two robot hands work together smoothly to fold clothes, pour tea, and pack shoes, coupled with the 1X humanoid robot NEO that has been making headlines recently, you may have a feeling: we seem to be entering the age of robots. In fact, these silky movements are the product of advanced robotic technology + exquisite frame design + multi-modal large models. We know that useful robots often require complex and exquisite interactions with the environment, and the environment can be represented as constraints in the spatial and temporal domains. For example, if you want a robot to pour tea, the robot first needs to grasp the handle of the teapot and keep it upright without spilling the tea, then move it smoothly until the mouth of the pot is aligned with the mouth of the cup, and then tilt the teapot at a certain angle. . this

ACL 2024 Awards Announced: One of the Best Papers on Oracle Deciphering by HuaTech, GloVe Time Test Award ACL 2024 Awards Announced: One of the Best Papers on Oracle Deciphering by HuaTech, GloVe Time Test Award Aug 15, 2024 pm 04:37 PM

At this ACL conference, contributors have gained a lot. The six-day ACL2024 is being held in Bangkok, Thailand. ACL is the top international conference in the field of computational linguistics and natural language processing. It is organized by the International Association for Computational Linguistics and is held annually. ACL has always ranked first in academic influence in the field of NLP, and it is also a CCF-A recommended conference. This year's ACL conference is the 62nd and has received more than 400 cutting-edge works in the field of NLP. Yesterday afternoon, the conference announced the best paper and other awards. This time, there are 7 Best Paper Awards (two unpublished), 1 Best Theme Paper Award, and 35 Outstanding Paper Awards. The conference also awarded 3 Resource Paper Awards (ResourceAward) and Social Impact Award (

Hongmeng Smart Travel S9 and full-scenario new product launch conference, a number of blockbuster new products were released together Hongmeng Smart Travel S9 and full-scenario new product launch conference, a number of blockbuster new products were released together Aug 08, 2024 am 07:02 AM

This afternoon, Hongmeng Zhixing officially welcomed new brands and new cars. On August 6, Huawei held the Hongmeng Smart Xingxing S9 and Huawei full-scenario new product launch conference, bringing the panoramic smart flagship sedan Xiangjie S9, the new M7Pro and Huawei novaFlip, MatePad Pro 12.2 inches, the new MatePad Air, Huawei Bisheng With many new all-scenario smart products including the laser printer X1 series, FreeBuds6i, WATCHFIT3 and smart screen S5Pro, from smart travel, smart office to smart wear, Huawei continues to build a full-scenario smart ecosystem to bring consumers a smart experience of the Internet of Everything. Hongmeng Zhixing: In-depth empowerment to promote the upgrading of the smart car industry Huawei joins hands with Chinese automotive industry partners to provide

See all articles