China Telecom and its partners jointly released national artificial intelligence large model service capability maturity assessment standards

China Telecom jointly released the National Artificial Intelligence Large Model Service Capability Maturity Assessment Standard

China Telecom, together with Tsinghua University and other relevant units, formulated the "Artificial Intelligence-Large Model Pre-training Model-Service Capability Maturity Assessment" 》standard has been certified by the Ministry of Industry and Information Technology and has become a national standard, and has been released on the artificial intelligence inspection and testing basic service platform of the Ministry of Industry and Information Technology. This standard provides a comprehensive testing method for evaluating the capability level of large models, and is of great significance to the development of large models in the industry. The formulation of this standard is the result of the joint efforts of China Telecom, Tsinghua University and other units, and it plays an important guiding role in promoting the development and application of artificial intelligence technology. It will provide a reference framework for enterprises and institutions to help them evaluate and improve the service capabilities of large models, and further promote the innovation and application of artificial intelligence technology. At the same time, the release of this standard will also provide a common standard for the industry and promote the standardization and healthy development of the industry. This will strengthen our country's competitiveness in the field of artificial intelligence and promote our country to become a global artificial intelligence

The standard defines the maturity assessment framework for large model pre-training services, including capability requirements, Maturity levels and assessment methods.

In terms of service capabilities, the pre-training maturity capability domain covers platform, development and customization, inference, and application services. The pre-trained large model platform service mainly focuses on providing a customized IT environment suitable for large model development to meet development needs. The model development customization service focuses on the development process of large models to ensure its smooth progress. The model reasoning and application domain focuses on the running status of the large model to ensure its normal operation in practical applications. The above service capabilities together constitute the core content of the pre-training maturity capability domain.

The model service maturity levels are divided into basic application level, collaborative optimization level, and customized production level. These three levels gradually increase the requirements for the basic technology, service complexity and customization capabilities of the pre-training model.

In terms of evaluation methods, the standard conducts a comprehensive assessment of pre-training service capabilities, clarifies the pre-training capabilities and key performance indicators that each maturity level should have, and provides clear guidance for the construction of large model pre-training service capabilities.

A new round of artificial intelligence technology, represented by large models, is becoming an important driving force for technological revolution and industrial change. China Telecom is continuously strengthening core technology research, especially playing an important role in promoting the in-depth evolution of basic general large models to vertical industry large models. They will focus on areas such as education, government affairs, agriculture, and emergency response, and plan to release 40 industry models, including precision teaching models, government service models, Shennong-1 models, and emergency response models. These large industry models will bring more accurate and efficient intelligent solutions to all walks of life.

The above is the detailed content of China Telecom and its partners jointly released national artificial intelligence large model service capability maturity assessment standards. For more information, please follow other related articles on the PHP Chinese website!