


CHEATC2023|Chen Xiaoping, University of Science and Technology of China: From large models to soft robots
Since the beginning of this year, with the continued popularity of ChatGPT, large models have also entered a period of rapid development. Many well-known domestic and foreign technology companies have successively launched independently developed large model products. So what is the technical principle of large models?
On May 18, Professor Chen Xiaoping, director of the Robotics Laboratory of the University of Science and Technology of China, who was invited to participate in the 2023 China Home Appliances Technology Conference (CHEATC2023), shared his research and views. He is also the director of the Artificial Intelligence Ethics of the China Artificial Intelligence Society. Together with the Chairman of the Governance Committee, Professor Chen Xiaoping delivered a keynote speech on "New Developments in Artificial Intelligence: From Large Models to Soft Robots" at this conference, introducing the technical principles of large artificial intelligence models and new developments in the application of artificial intelligence. Technology trends.
Professor Chen Xiaoping of University of Science and Technology of China
"The fundamental principle of big models is to make predictions," Chen Xiaoping said. The development of artificial intelligence has now begun the process of the fourth wave, and data models have also shifted from big data-driven to big training-driven. Different from the previous three waves, the new stage of artificial intelligence has new requirements for the quality, quantity and acquisition methods of training data, and finally forms an example model that can be applied to large-scale real scenes. He emphasized that a large model is an intelligent system integrated by multiple technologies, rather than a simple combination of a single or a few technologies. ”
The rise of large models comes from generative artificial intelligence. Currently, generative artificial intelligence is not just a simple generation of content such as language and images, but also completes intelligence based on the precise processing of human natural language. Human-computer interaction. Chen Xiaoping said: "At this stage, our expectation for machine language processing is that it can speak human language, understand human language, and answer questions, even if the answer may not be correct. Among them, the basic requirement is that the speech must conform to human language habits. "Since there are no scientific standards for human language habits but there are empirical standards, how can machines master and utilize human language habits? Chen Xiaoping said: "The basic research idea and secret of success of large models is: extract language from large-scale human corpora. Traces and used in human-computer natural language interaction.”
The large model extracts semantic elements including characters, words, punctuation marks, etc. from the original human corpus, and then performs semantic review based on the correlation between the preceding and following semantic elements, and finally achieves behavioral prediction. In principle, the greater the number of semantic elements that are looked back, the higher the accuracy of prediction. At least 4,000 tokens can be reviewed by large models, and some models can review up to 100,000 tokens. "Chen Xiaoping said. The large model technology system is based on the pre-trained model, and then uses a specially trained special model to cooperate with the user guidance model to accurately understand and answer the user's questions. The three major models cooperate with each other, and the quality of the artificial intelligence answer can be Achieve substantial improvement.
Although the emergence of large-scale models has brought new innovative directions to artificial intelligence, it is not applicable to all aspects of real-world scenarios. According to Chen Xiaoping, the three major areas of artificial intelligence that China currently needs to conquer are intelligent manufacturing, intelligent agriculture and inclusive elderly care. "Overcoming these three major battles will completely change our global landscape." On the other hand, large models bring huge changes but also bring new challenges. When large models are based on imitations of human functions, they are likely to be thought of as having emotions and consciousness. This is because people habitually apply their understanding of a concept to the overall structure involving that concept, thinking that the information expressed by the structure also has the same meaning, but in fact this is not the case. "Chen Xiaoping said that the application of large models may also have public safety, employment and long-term impacts.
In addition to large-scale models, Professor Chen Xiaoping also achieved new scientific research results on "artificial intelligence in the physical world". At present, the physical form of artificial intelligence we put into application is mainly rigid robots. This kind of robot has high repeatability, but low dexterity and safety. It is suitable for structured environments, but needs to be carried out in unstructured environments. Accurate measurement, modeling and calculation require high technical requirements and are currently not suitable for most industries. In response to these shortcomings of rigid robots, Chen Xiaoping proposed the principle of fusion, under the three basic assumptions that accurate measurement of the operating objects of intelligent robots is not feasible, accurate modeling of the working environment and operating objects is not feasible, and precise decision-making is not feasible. , developed a pneumatic honeycomb network software arm. This kind of arm has good performance in terms of flexibility and load capacity, and can achieve precise control when there is external interference and irregular movement of objects. It is expected that this technology will have broad application prospects in fields such as home services, emotional interaction, and autonomous driving. On the other hand, Chen Xiaoping's team also combined a flexible arm with a rigid machine, resulting in the experimental results of "rigid and soft claws in one", which enabled the robot to achieve control without changing the program and hardware parameters or using force feedback sensors. Precise gripping of multi-shaped objects.
The above is the detailed content of CHEATC2023|Chen Xiaoping, University of Science and Technology of China: From large models to soft robots. For more information, please follow other related articles on the PHP Chinese website!

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

AI Hentai Generator
Generate AI Hentai for free.

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics



On May 30, Tencent announced a comprehensive upgrade of its Hunyuan model. The App "Tencent Yuanbao" based on the Hunyuan model was officially launched and can be downloaded from Apple and Android app stores. Compared with the Hunyuan applet version in the previous testing stage, Tencent Yuanbao provides core capabilities such as AI search, AI summary, and AI writing for work efficiency scenarios; for daily life scenarios, Yuanbao's gameplay is also richer and provides multiple features. AI application, and new gameplay methods such as creating personal agents are added. "Tencent does not strive to be the first to make large models." Liu Yuhong, vice president of Tencent Cloud and head of Tencent Hunyuan large model, said: "In the past year, we continued to promote the capabilities of Tencent Hunyuan large model. In the rich and massive Polish technology in business scenarios while gaining insights into users’ real needs

Tan Dai, President of Volcano Engine, said that companies that want to implement large models well face three key challenges: model effectiveness, inference costs, and implementation difficulty: they must have good basic large models as support to solve complex problems, and they must also have low-cost inference. Services allow large models to be widely used, and more tools, platforms and applications are needed to help companies implement scenarios. ——Tan Dai, President of Huoshan Engine 01. The large bean bag model makes its debut and is heavily used. Polishing the model effect is the most critical challenge for the implementation of AI. Tan Dai pointed out that only through extensive use can a good model be polished. Currently, the Doubao model processes 120 billion tokens of text and generates 30 million images every day. In order to help enterprises implement large-scale model scenarios, the beanbao large-scale model independently developed by ByteDance will be launched through the volcano

"High complexity, high fragmentation, and cross-domain" have always been the primary pain points on the road to digital and intelligent upgrading of the transportation industry. Recently, the "Qinling·Qinchuan Traffic Model" with a parameter scale of 100 billion, jointly built by China Vision, Xi'an Yanta District Government, and Xi'an Future Artificial Intelligence Computing Center, is oriented to the field of smart transportation and provides services to Xi'an and its surrounding areas. The region will create a fulcrum for smart transportation innovation. The "Qinling·Qinchuan Traffic Model" combines Xi'an's massive local traffic ecological data in open scenarios, the original advanced algorithm self-developed by China Science Vision, and the powerful computing power of Shengteng AI of Xi'an Future Artificial Intelligence Computing Center to provide road network monitoring, Smart transportation scenarios such as emergency command, maintenance management, and public travel bring about digital and intelligent changes. Traffic management has different characteristics in different cities, and the traffic on different roads

1. Product positioning of TensorRT-LLM TensorRT-LLM is a scalable inference solution developed by NVIDIA for large language models (LLM). It builds, compiles and executes calculation graphs based on the TensorRT deep learning compilation framework, and draws on the efficient Kernels implementation in FastTransformer. In addition, it utilizes NCCL for communication between devices. Developers can customize operators to meet specific needs based on technology development and demand differences, such as developing customized GEMM based on cutlass. TensorRT-LLM is NVIDIA's official inference solution, committed to providing high performance and continuously improving its practicality. TensorRT-LL

According to news on April 4, the Cyberspace Administration of China recently released a list of registered large models, and China Mobile’s “Jiutian Natural Language Interaction Large Model” was included in it, marking that China Mobile’s Jiutian AI large model can officially provide generative artificial intelligence services to the outside world. . China Mobile stated that this is the first large-scale model developed by a central enterprise to have passed both the national "Generative Artificial Intelligence Service Registration" and the "Domestic Deep Synthetic Service Algorithm Registration" dual registrations. According to reports, Jiutian’s natural language interaction large model has the characteristics of enhanced industry capabilities, security and credibility, and supports full-stack localization. It has formed various parameter versions such as 9 billion, 13.9 billion, 57 billion, and 100 billion, and can be flexibly deployed in Cloud, edge and end are different situations

1. Background Introduction First, let’s introduce the development history of Yunwen Technology. Yunwen Technology Company...2023 is the period when large models are prevalent. Many companies believe that the importance of graphs has been greatly reduced after large models, and the preset information systems studied previously are no longer important. However, with the promotion of RAG and the prevalence of data governance, we have found that more efficient data governance and high-quality data are important prerequisites for improving the effectiveness of privatized large models. Therefore, more and more companies are beginning to pay attention to knowledge construction related content. This also promotes the construction and processing of knowledge to a higher level, where there are many techniques and methods that can be explored. It can be seen that the emergence of a new technology does not necessarily defeat all old technologies. It is also possible that the new technology and the old technology will be integrated with each other.

If the test questions are too simple, both top students and poor students can get 90 points, and the gap cannot be widened... With the release of stronger models such as Claude3, Llama3 and even GPT-5 later, the industry is in urgent need of a more difficult and differentiated model Benchmarks. LMSYS, the organization behind the large model arena, launched the next generation benchmark, Arena-Hard, which attracted widespread attention. There is also the latest reference for the strength of the two fine-tuned versions of Llama3 instructions. Compared with MTBench, which had similar scores before, the Arena-Hard discrimination increased from 22.6% to 87.4%, which is stronger and weaker at a glance. Arena-Hard is built using real-time human data from the arena and has a consistency rate of 89.1% with human preferences.

According to news on June 13, according to Byte's "Volcano Engine" public account, Xiaomi's artificial intelligence assistant "Xiao Ai" has reached a cooperation with Volcano Engine. The two parties will achieve a more intelligent AI interactive experience based on the beanbao large model. It is reported that the large-scale beanbao model created by ByteDance can efficiently process up to 120 billion text tokens and generate 30 million pieces of content every day. Xiaomi used the beanbao large model to improve the learning and reasoning capabilities of its own model and create a new "Xiao Ai Classmate", which not only more accurately grasps user needs, but also provides faster response speed and more comprehensive content services. For example, when a user asks about a complex scientific concept, &ldq
