Technology peripherals
AI
Challenges and investment strategies faced by data centers in the AI era
Challenges and investment strategies faced by data centers in the AI era
Artificial intelligence applications must be supported by massive computing power, which means larger and richer data centers.
As the application of artificial intelligence increases, the data center market is growing rapidly to accommodate the surge in data caused by these technologies. Adding artificial intelligence to the already vast array of technologies available, including Internet of Things (IoT) devices, will generate even more customer data, causing data volumes to grow exponentially.
The bottom line is that all this data needs to reside somewhere, and organizations will move to data centers.
Kevin Shtofman, director of innovation at Cherre, explained that artificial intelligence will increase the demand for computing power, requiring investment in artificial intelligence-specific hardware, adopting new data center designs, and exploring emerging technologies such as edge computing.
“Artificial intelligence applications require a lot of computing power when training complex deep learning models,” Shtofman said. As artificial intelligence becomes more popular, more data centers will be needed to support the growing demand for computing power. ”
The adoption of artificial intelligence will also increase data storage requirements, as AI-driven applications require large amounts of data to train and improve models.
According to Shtofman, it needs to be stored and accessed quickly This data requires a large storage capacity. Therefore, data centers will need to expand their storage capabilities to meet the growing demand."
Shtofman added that as artificial intelligence applications become more and more widespread, There is also an increasing need for real-time processing and decision-making. This has given rise to the rise of edge computing, which involves processing data closer to the source rather than sending it to centralized data centers. Therefore, more data centers need to be built closer to the edge to support this trend.
AI-driven computing power demand
Andy Cvengros, managing director of technology at Jones Lang LaSalle, pointed out that as the capabilities of artificial intelligence are integrated with daily technology functions, artificial intelligence at the consumer level is expected to Intelligence will explode. "As usage becomes more common, this will lead to a huge demand for data center computing power," Cvengros said. "Running and training these models requires a lot of computing power and a lot of resources, which limits the enterprises that can make breakthroughs." Quantity.”
The density of server computers required for AI also generates large amounts of heat, and to address this, innovations in liquid cooling are developing. To meet this growing demand, cloud computing companies are actively looking for development projects to acquire hundreds of megawatts of power in just a few years.
According to Cvengros: "The available power capacity in the primary data center market has been exhausted, and the secondary and tertiary markets can take this opportunity to expand.". ”
Cvengros pointed out that major cloud computing companies are adopting self-build and lease data center models. Hyperscale cloud users and colocation providers are scrambling to find high-performance land sites in almost all markets to support These are huge capacity needs.
Ten years ago, a data center requiring 10 megawatts was considered quite large, but by 2023, it is not uncommon to announce the construction of data centers exceeding 100 megawatts. Cvengros said: “When hyperscalers are unable to build data centers in a specific market due to land, power or supply chain constraints, they may rent the entire data center from a colocation provider, making it difficult for smaller businesses with smaller needs. Difficulty finding enough space. ”
Key stakeholders such as cloud service providers and data center operators
Shtofman said that the main stakeholders in ensuring that data centers grow with the demand generated by artificial intelligence computing are data Center operators, cloud service providers, hardware manufacturers, government and regulatory agencies, as well as data scientists and artificial intelligence researchers.
Data center operators are responsible for managing and maintaining the physical infrastructure of supply-side data centers. The provider's AI applications can be supported by the computing resources and infrastructure provided on demand by the cloud service provider. To meet the demands generated by AI computing, including computing power, storage and network capabilities, they must ensure that they have sufficient capabilities.
At the same time, hardware manufacturers are responsible for designing and producing the specialized hardware required for artificial intelligence computing on the supply side, such as graphics processing units (GPUs) and tensor processing units (TPUs).
Shtofman "They must ensure adequate supply of these specialized components to support growing demand," said the company. This is a higher risk given recent issues with global supply chains. ”
Cvengros agreed that components needed to build and operate data centers have been delayed due to supply chain challenges and geopolitical tensions during the pandemic. This has delayed construction timelines, but as demand remains strong , users have shifted to pre-leases.
It is expected that the majority of new supply of vacant pipelines by the end of 2023 or 2024 will be pre-leases.
In Cvengros’ view, maintaining until safety needs are met Suppliers with large supply chain inventories will stand out in the competition to win hyperscale business.
Develop an Investment Plan
Before expanding a data center, it is crucial to conduct in-depth research and analysis of the market and artificial intelligence computing needs, which is what Shtofman emphasized. "This will help demonstrate that the investment is aligned with market needs and that there is a clear path to return on investment. This market appears to be very prosperous, involving multiple transportation modes and role types, and therefore requires the use of edge computing technology."
It is recommended to develop a comprehensive strategy and update it frequently, because this market changes much faster than other cycles. "Data center assets require very specific infrastructure, design and compliance with local laws. For newbies, working with an experienced partner is best practice and this type of construction is not for them."
The above is the detailed content of Challenges and investment strategies faced by data centers in the AI era. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
AI Hentai Generator
Generate AI Hentai for free.
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
1384
52
Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions
Jun 28, 2024 am 03:51 AM
This site reported on June 27 that Jianying is a video editing software developed by FaceMeng Technology, a subsidiary of ByteDance. It relies on the Douyin platform and basically produces short video content for users of the platform. It is compatible with iOS, Android, and Windows. , MacOS and other operating systems. Jianying officially announced the upgrade of its membership system and launched a new SVIP, which includes a variety of AI black technologies, such as intelligent translation, intelligent highlighting, intelligent packaging, digital human synthesis, etc. In terms of price, the monthly fee for clipping SVIP is 79 yuan, the annual fee is 599 yuan (note on this site: equivalent to 49.9 yuan per month), the continuous monthly subscription is 59 yuan per month, and the continuous annual subscription is 499 yuan per year (equivalent to 41.6 yuan per month) . In addition, the cut official also stated that in order to improve the user experience, those who have subscribed to the original VIP
Context-augmented AI coding assistant using Rag and Sem-Rag
Jun 10, 2024 am 11:08 AM
Improve developer productivity, efficiency, and accuracy by incorporating retrieval-enhanced generation and semantic memory into AI coding assistants. Translated from EnhancingAICodingAssistantswithContextUsingRAGandSEM-RAG, author JanakiramMSV. While basic AI programming assistants are naturally helpful, they often fail to provide the most relevant and correct code suggestions because they rely on a general understanding of the software language and the most common patterns of writing software. The code generated by these coding assistants is suitable for solving the problems they are responsible for solving, but often does not conform to the coding standards, conventions and styles of the individual teams. This often results in suggestions that need to be modified or refined in order for the code to be accepted into the application
Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations
Jun 11, 2024 pm 03:57 PM
Large Language Models (LLMs) are trained on huge text databases, where they acquire large amounts of real-world knowledge. This knowledge is embedded into their parameters and can then be used when needed. The knowledge of these models is "reified" at the end of training. At the end of pre-training, the model actually stops learning. Align or fine-tune the model to learn how to leverage this knowledge and respond more naturally to user questions. But sometimes model knowledge is not enough, and although the model can access external content through RAG, it is considered beneficial to adapt the model to new domains through fine-tuning. This fine-tuning is performed using input from human annotators or other LLM creations, where the model encounters additional real-world knowledge and integrates it
Seven Cool GenAI & LLM Technical Interview Questions
Jun 07, 2024 am 10:06 AM
To learn more about AIGC, please visit: 51CTOAI.x Community https://www.51cto.com/aigc/Translator|Jingyan Reviewer|Chonglou is different from the traditional question bank that can be seen everywhere on the Internet. These questions It requires thinking outside the box. Large Language Models (LLMs) are increasingly important in the fields of data science, generative artificial intelligence (GenAI), and artificial intelligence. These complex algorithms enhance human skills and drive efficiency and innovation in many industries, becoming the key for companies to remain competitive. LLM has a wide range of applications. It can be used in fields such as natural language processing, text generation, speech recognition and recommendation systems. By learning from large amounts of data, LLM is able to generate text
Samsung introduces BM1743 data center-grade SSD: equipped with v7 QLC V-NAND and supports PCIe 5.0
Jun 18, 2024 pm 04:15 PM
According to news from this website on June 18, Samsung Semiconductor recently introduced its next-generation data center-grade solid-state drive BM1743 equipped with its latest QLC flash memory (v7) on its technology blog. ▲Samsung QLC data center-grade solid-state drive BM1743 According to TrendForce in April, in the field of QLC data center-grade solid-state drives, only Samsung and Solidigm, a subsidiary of SK Hynix, had passed the enterprise customer verification at that time. Compared with the previous generation v5QLCV-NAND (note on this site: Samsung v6V-NAND does not have QLC products), Samsung v7QLCV-NAND flash memory has almost doubled the number of stacking layers, and the storage density has also been greatly improved. At the same time, the smoothness of v7QLCV-NAND
Five schools of machine learning you don't know about
Jun 05, 2024 pm 08:51 PM
Machine learning is an important branch of artificial intelligence that gives computers the ability to learn from data and improve their capabilities without being explicitly programmed. Machine learning has a wide range of applications in various fields, from image recognition and natural language processing to recommendation systems and fraud detection, and it is changing the way we live. There are many different methods and theories in the field of machine learning, among which the five most influential methods are called the "Five Schools of Machine Learning". The five major schools are the symbolic school, the connectionist school, the evolutionary school, the Bayesian school and the analogy school. 1. Symbolism, also known as symbolism, emphasizes the use of symbols for logical reasoning and expression of knowledge. This school of thought believes that learning is a process of reverse deduction, through existing
To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework
Jul 25, 2024 am 06:42 AM
Editor |ScienceAI Question Answering (QA) data set plays a vital role in promoting natural language processing (NLP) research. High-quality QA data sets can not only be used to fine-tune models, but also effectively evaluate the capabilities of large language models (LLM), especially the ability to understand and reason about scientific knowledge. Although there are currently many scientific QA data sets covering medicine, chemistry, biology and other fields, these data sets still have some shortcomings. First, the data form is relatively simple, most of which are multiple-choice questions. They are easy to evaluate, but limit the model's answer selection range and cannot fully test the model's ability to answer scientific questions. In contrast, open-ended Q&A
SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time
Jul 17, 2024 pm 06:37 PM
Editor | KX In the field of drug research and development, accurately and effectively predicting the binding affinity of proteins and ligands is crucial for drug screening and optimization. However, current studies do not take into account the important role of molecular surface information in protein-ligand interactions. Based on this, researchers from Xiamen University proposed a novel multi-modal feature extraction (MFE) framework, which for the first time combines information on protein surface, 3D structure and sequence, and uses a cross-attention mechanism to compare different modalities. feature alignment. Experimental results demonstrate that this method achieves state-of-the-art performance in predicting protein-ligand binding affinities. Furthermore, ablation studies demonstrate the effectiveness and necessity of protein surface information and multimodal feature alignment within this framework. Related research begins with "S
