Huawei Cloud Youpeng: Pangu model, shared wisdom, service industry

On August 30, Huawei Cloud held the Pangu Large Model Theme Forum in Beijing with the theme of "Opening up and flying together, a new era of win-win industry AI". In his speech "Pangu Large Model, Born for the Industry", You Peng, Director of Huawei Cloud EI Service Product Department, deeply discussed the development trends, technological innovation practices, and industry development opportunities of AI large models. You Peng said that large models are reshaping various industries. Huawei Cloud will make full use of its technological accumulation and engineering capability advantages in the field of large models to help customers and partners quickly build the development and application capabilities of Pangu large models, making it a common choice for everyone. The core driving force for enterprises to achieve strategic transformation and intelligent upgrade

Huawei CloudPosted by You Peng, Director of EI Service Product Department Keynote Speech

Pangu large model adopts hierarchical decoupling of a three-layer architecture, which has natural eco-friendly features

As large models gradually accelerate the industry With the transformation of intelligence, more and more industry core business systems are beginning to be penetrated by large model capabilities. Huawei Cloud has been committed to providing AI solutions to all walks of life. By creating the Pangu Big Model, it promotes the intelligent upgrading of thousands of industries. You Peng introduced that the Pangu Big Model provides 5 basic large models for N industries. The three-layer decoupling architecture of the large model X scene model naturally has good ecological openness. Based on the hierarchical decoupling architecture, Pangu Big Model provides two application modes: call integration and customized joint creation, which can be quickly adapted to meet the business demands of various scenarios. In call integration mode, Huawei Cloud L0 Pangu basic large model provides more than 100 capability sets. Each capability set is decoupled from each other and can be directly called through API. Enterprise users can select the required capability set according to the needs of business scenarios and use the Pangu large model workflow to quickly develop industry scenario applications. Under the customized joint innovation model, enterprises can quickly train their own industry-specific large models through secondary training on their own data based on the L0 or L1 Pangu large model. At the same time, according to the different data security and compliance requirements of customers, Pangu Large Model also provides diversified deployment forms of public cloud, large model cloud zone, and hybrid cloud.

Huawei Cloud Ascend AI Cloud Service provides powerful and immediately available computing power for the training of large models, and provides customers and partners with leading and sustainable AI computing infrastructure for the development, deployment, and operation of large models.

In addition, the content to be rewritten is: while maintaining the original meaning, the language needs to be changed to Chinese. Huawei Cloud will actively participate in the implementation of the Pangu model in the industry, which is inseparable from a prosperous ecological environment. We will work closely with customer partners from all walks of life to jointly establish a comprehensive and collaborative ecosystem and provide users with rich industry scenario solutions. These solutions will be more focused on specific application scenarios or business needs, and provide users with plug-and-play model services

Pangu large model engineering suite,

5x speed development Industry Large ModelYou Peng said that in order to meet the challenges of implementing general large models in the industry, Huawei Cloud provides a large model engineering suite, which includes three major suites: data engineering, model development, and application development. By using the Pangu Large Model Engineering Suite, it is now possible to complete the end-to-end development of a 100 billion industry model within one month. Compared with the five months it took in the past, the overall speed has increased five times.

In data In terms of engineering suites, compared with traditional annotation platforms, the data engineering suite of Pangu Large Model provides a template-based prompt online auxiliary writing function for SFT training, and provides multi-person Rank online annotation and task allocation functions for RLHF training. Compared with offline, the measured efficiency of these two tasks can be increased by 3 times. In addition, the data engineering suite also has 50 built-in data cleaning operators for data cleaning problems, which can handle more than 90% of cleaning scenarios and greatly improve cleaning performance

In terms of model development kit, the large model development kit provides Three workflows, including self-supervised training, supervised fine-tuning and reinforcement learning training. These workflows cover the entire process from hyperparameter configuration to model training, evaluation, management, and deployment. The large model development kit condenses the practical experience of large model experts, streamlines, standardizes and simplifies complex large model development, helping industry users to easily start and one-stop develop large models suitable for their industry. At the same time, through model quantification and various inference acceleration technologies, the inference throughput is greatly improved, so that the throughput can be increased by 10 times, thus greatly optimizing the inference performance of the model

In terms of application development kits, Pangu application development kits combine traditional software engineering with large models to provide a flexible SDK-based development method. It only takes 2 lines of code to complete large model access and only takes 5 minutes. It can complete the development of large-model applications and support enterprises to build large-model native applications in minutes. As the first large model application development kit in the industry that provides both Python and Java versions of SDK, it supports broader and more comprehensive large model application development capabilities. Pangu application development kit is well compatible with the open source ecosystem, realizing "everything can be orchestrated", and combined with visual orchestration services, helps users better use various tools and skills on large models

Co-construction Pangu's large model collaborates across the entire ecosystem to share industryNew AI opportunities

The innovation of the large model is not only the innovation of the model itself and the innovation of various AI root technologies, but also the innovation of computing power. , algorithms, platforms, applications, services, etc. also require the participation of full-chain ecological partners and customers. For its three main partners: software partners, service partners, and digital transformation and system integration partners, Huawei Cloud has opened up a comprehensive ecological cooperation path including industry large models, software solutions, plug-in integration, digital transformation consulting, and data ecology

Huawei Cloud provides software partners with three open ecological cooperation paths, namely model joint creation, solution construction, and plug-in integration. We work with partners with data accumulation and industry experience to jointly build industry models and scenario models to create an intelligent base. Cooperate with partners who have practical industry experience, large model integration and development technology to jointly build industry-oriented segmented scenario models and provide replicable software solutions. At the same time, we collaborate with enterprise service software and tool software partners to improve the skill set of the Pangu large model through a variety of plug-ins and broaden the capabilities of the large model

The Huawei Cloud Open Project provides opportunities for service partners. By granting various rights and interests, such as certification, technical support and incentives, we help partners quickly build business models and achieve sustainable and rapid development. We are committed to providing high-quality services in the last mile of Pangu's large-scale model implementation and realizing a closed-loop business for large-scale models.

In order to achieve digital transformation, Huawei Cloud conducts BP interlocking and Offering co-construction with system-qualified partners to Partners with the goal of deeply cultivating customers and providing customers with consulting and system integration services related to Pangu large model services

You Peng finally said that Huawei Cloud welcomes more industry customers and partners to join the Pangu large model and jointly shape the The future of thousands of industries. We hope to create an ecosystem together, innovate together, and share value and opportunities

The above is the detailed content of Huawei Cloud Youpeng: Pangu model, shared wisdom, service industry. For more information, please follow other related articles on the PHP Chinese website!