Youked builds a kilo-calorie inference cluster for Zhipu AI to help global users enjoy large-model smart life

Back to one night in 2021, a mother fell into a creative bottleneck and was unable to continue her novel; the father was busy writing code, envisioning developing a small game after work, but was troubled by code debugging problems; and Their children, facing a Mathematical Olympiad problem on the desk, frowned and thought hard.

Today in 2024, the emergence of large AI models changes all this.

With the help of "Zhipu Qingyan", my mother's novel creation has taken on a new lease of life. She only needs to input her creativity and ideas into the large model to generate Natural and vivid storylines and dialogues; Dad uses large models for code programming and debugging. By analyzing the code logic, he greatly reduces the tedious development process and reduces the workload by more than half; the large models have also become a learning tool for children. The assistant can not only perform intelligent homework corrections, but also provide detailed problem-solving ideas, greatly improving learning efficiency.

Large model computing power allows global users to enjoy intelligent life

Zhipu AI is committed to building the world's leading recognition platform Zhizhi Intelligent Large Model, the performance of its new generation base large model GLM-4 has been greatly improved, approaching GPT-4, demonstrating the industry's leading multi-modal large language model capabilities. Through the powerful combination of the large model of Intelligent Spectrum and the computing power of Youked, GLM-4 runs stably and efficiently on the cloud, and has large-scale real-time reasoning capabilities, successfully achieving a balance between cost-effectiveness and service quality. This innovation enables the smart spectrum model to deeply understand user needs and respond quickly, allowing users around the world to enjoy the convenience and efficiency of intelligent life in advance.

As early as 2022, Youked has begun to provide powerful underlying computing power support for Zhipu AI. Ucarte's low-cost, high-value-added Ulanqab Intelligent Computing Center provides customized high-power cabinets and abundant GPU computing power, which can help quickly build large-scale intelligent models, expand the scale of training and inference clusters, and improve models. R&D efficiency, supporting the rapid launch of large model applications and external services. At present, the total computing power management scale of Ukede Intelligent Computing Center exceeds 3000P.

Ukede Ulanqab Intelligent Computing Center

Ukerde helps Zhipu AI build a super-kilobyte scale inference cluster

Since the official launch of "Zhipu Qingyan", it has attracted millions of users every day, facing the problem of text, Large-scale real-time reasoning requirements in multiple scenarios such as pictures and videos. In order to meet the surge in model computing needs, it is necessary to continue to expand the number of computing cards and build a kilo-card level inference cluster to further improve computing resource utilization and inference performance.

Uked’s inference service platform provides ultra-large-scale integrated computing power and supports unified scheduling and management of computing clusters. At present, Ucadex has successfully assisted Zhipu AI in building an inference cluster with a scale of over 1,000 cards. At the same time, with the support of Youked cloud interoperability products, the platform also has powerful "hybrid networking capabilities", allowing large models to achieve integrated training and promotion. Computing resource management based on the full life cycle not only ensures the efficient and stable operation of large models, enabling them to cope with various complex reasoning tasks, but also provides solid technical guarantee for real-time response of cloud services.

Match full-stack computing resources to achieve diversified reasoning scenario coverage

The smart spectrum large model is widely used in intelligent programming, intelligent writing and other fields, providing services for various industries Intelligent upgrades provide strong technical support. Whether processing multi-modal data such as text, images or videos, the smart spectrum large model can demonstrate excellent performance and flexibility.

Uked’s inference service platform matches full-stack computing resources, is compatible with diverse scenarios such as general large models and industry large models, and provides flexible and stable inference services for various models such as text and image generation and code generation. Meet the needs of large-scale real-time reasoning in various computing power scenarios. Among them, "CodeGeeX" is a large-model-based intelligent programming assistant launched by Zhipu AI with the support of Youkede's flexible and flexible computing power deployment solution. It can generate and complete code, automatically add comments, Functions such as code translation and intelligent question and answer help programmers write 20 million lines of code every day, significantly improving work efficiency.

In addition to model inference services on the public cloud, Ucade also supports privatized deployment of large models. Ucade and Zhipu AI are exploring a new way of cooperation based on the "large model all-in-one machine". The jointly launched industry large model solution can better help finance, medical, automobile, manufacturing and other industries quickly implement large model business . At present, Ucade's reasoning service platform has integrated rich industry model resources. These industry models can be customized for different industry needs, providing more accurate and efficient reasoning capabilities.

Significantly reduce inference costs and achieve a balance between cost-effectiveness and service quality

As AIGC technology continues to evolve, its reliance on GPU computing power has become increasingly obvious. While large model companies are pursuing excellent computing performance, they are also paying more and more attention to the utilization efficiency and cost requirements of inference computing power.

Currently, Ukede has introduced advanced GPU resource management and scheduling mechanisms to provide flexible and reliable performance support for large smart spectrum models. Through intelligent allocation and dynamic adjustment of cluster tasks, the load pressure on a single node is effectively reduced, while idleness and excessive consumption of computing resources are avoided. Under this refined resource management method, Ukerde helps significantly improve the computing power utilization of large smart spectrum models, bringing an economical and efficient large model inference experience. Ucade's products are significantly better than similar competitors in terms of inference costs, successfully achieving a balance between cost-effectiveness and service quality.

At the same time, Zhipu AI uses the UPFS parallel file system independently developed by Ukede to optimize model inference performance. UPFS supports IB/RoCE networks, providing access to data in hundreds of microseconds and read and write throughputs of up to hundreds of GB/s, further improving the efficiency of data transmission and communication.

In the future, Ucade will work hand in hand with Zhipu AI to promote the continuous innovation and application of large model technology with a more flexible and reliable intelligent computing base. It is believed that through the close cooperation and unremitting efforts of both parties, large models will take root in various fields and be fully integrated into production and life. More users and more families can enjoy intelligent, efficient and convenient artificial intelligence experiences.

The above is the detailed content of Youked builds a kilo-calorie inference cluster for Zhipu AI to help global users enjoy large-model smart life. For more information, please follow other related articles on the PHP Chinese website!