Home Technology peripherals AI Gartner: Generative AI will drive the transformation of Chinese enterprise data center design

Gartner: Generative AI will drive the transformation of Chinese enterprise data center design

Apr 16, 2024 pm 10:41 PM
AI data center

Gartner: Generative AI will drive the transformation of Chinese enterprise data center design

According to news on April 15, 2024, a 2024 CIO and technology executive survey recently released by Gartner showed that more than 60% of Chinese companies plan to Deploy generative artificial intelligence (GenAI) within 24 months. Since Chinese companies tend to deploy GenAI locally rather than through the public cloud, the current infrastructure environment cannot support GenAI projects. This will promote the design transformation of Chinese enterprise data centers.

Zhang Lukeng, research director at Gartner, said: “Due to security and data privacy concerns and regulatory requirements, some enterprises prefer to deploy GenAl solutions or fine-tune large language models (LLM) on-premises. Deploying on-premises GenAl is not just a simple hosting requirement for data centers, but may change the strategy of enterprise data centers because model training requires large-scale GPU clusters."

Gartner defines five types of GenAI deployments. method (see Figure 1). Depending on the GenAI deployment method chosen by the enterprise, China's chief information officers (CIOs) and infrastructure and operations (I&O) leaders need to understand the impact of GenAI deployment and how to take action.

Figure 1: Five methods for generative artificial intelligence deployment


Gartner: Generative AI will drive the transformation of Chinese enterprise data center designGartner: Generative AI will drive Chinese enterprise data centers Design Transformation

China’s CIOs and I&O leaders must prepare for the impact of this technology on the data center.

Deploying GenAI on-premises will force I&O leaders to change how they design hosting environments

The impact of deploying GenAI on the data center determines the types of workloads run, as some GenAI workloads require High-end graphics processing unit (GPU). Due to the limited supply of high-end GPUs in the Chinese market, I&O leaders who want to deploy GenAI on-premises will need to change the way their hosting environments are designed.

I&O leaders cannot solve supply shortages alone and must work with the business, AI engineers, and functional teams to address this challenge.

Zhang Yingling said: “Chinese CIOs and I&O leaders who prepare infrastructure resources for GenAl deployment should proactively work with business and related teams to predict the impact of different workloads on data center costs and schedules. , to develop a data center macro strategy for GenAl deployment. If training models require high-end GPU clusters, you need to fully understand various hosting options by balancing costs, risks, and opportunities (such as purchasing alternative hardware or leasing GPU resources).”

Deploying large-scale GPU clusters requires transforming and upgrading data center infrastructure and equipment

Building a basic model from scratch or fine-tuning a model requires deploying large-scale GPU clusters, which will bring consequences to existing data centers subversion. Because the training of GenAI models requires high throughput, low latency, and lossless infrastructure. To support such high-performance computing clusters, network, storage, power supply, and cooling systems must be upgraded. In some cases, existing facilities will need to be retrofitted to host the upgraded infrastructure (see Figure 2).

Figure 2: The impact of large-scale GPU clusters on data centers


Gartner: Generative AI will drive the transformation of Chinese enterprise data center designGartner: Generative AI will drive Chinese enterprise data centers Design Transformation

Zhang Yingling said: "China's CIO and I&O leaders need to work with data scientists and engineers to clarify the GPU cluster size and GenAI performance requirements to determine infrastructure such as network and storage. Requirements. At the same time, it is also necessary to analyze power requirements, cooling efficiency, racks, space, etc., to determine the gaps in the existing data center environment in deploying large GPU clusters, and to select the most suitable data center transformation solution.

The above is the detailed content of Gartner: Generative AI will drive the transformation of Chinese enterprise data center design. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions Jun 28, 2024 am 03:51 AM

Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions

Context-augmented AI coding assistant using Rag and Sem-Rag Context-augmented AI coding assistant using Rag and Sem-Rag Jun 10, 2024 am 11:08 AM

Context-augmented AI coding assistant using Rag and Sem-Rag

Seven Cool GenAI & LLM Technical Interview Questions Seven Cool GenAI & LLM Technical Interview Questions Jun 07, 2024 am 10:06 AM

Seven Cool GenAI & LLM Technical Interview Questions

Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations Jun 11, 2024 pm 03:57 PM

Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations

To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework Jul 25, 2024 am 06:42 AM

To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework

SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time Jul 17, 2024 pm 06:37 PM

SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time

Samsung introduces BM1743 data center-grade SSD: equipped with v7 QLC V-NAND and supports PCIe 5.0 Samsung introduces BM1743 data center-grade SSD: equipped with v7 QLC V-NAND and supports PCIe 5.0 Jun 18, 2024 pm 04:15 PM

Samsung introduces BM1743 data center-grade SSD: equipped with v7 QLC V-NAND and supports PCIe 5.0

Five schools of machine learning you don't know about Five schools of machine learning you don't know about Jun 05, 2024 pm 08:51 PM

Five schools of machine learning you don't know about

See all articles