According to news from this website on August 12, TrendForce released a report today. Due to the sharp increase in AI demand, AI server-related customers have further requested suppliers to order more Enterprise SSDs (enterprise-grade solid-state drives) in the past two quarters. In order to meet the supply of SSD for AI applications, upstream suppliers have accelerated process upgrades and begun planning to launch 2YY products, which are expected to be mass-produced in 2025.
The report shows that AI server customers’ increased orders from suppliers have caused the cumulative increase in Enterprise SSD contract prices to exceed 80% between the fourth quarter of 2023 and the third quarter of 2024. SSD plays an important role in the development of AI. In addition to the AI model training process, SSD is not only responsible for storing model parameters, including constantly updated weights and biases. Another important application is to create check points to regularly save AI. Model training progress, allowing recovery from a specific point even if training is interrupted. The above functions rely heavily on high-speed transmission and write endurance, so customers mainly choose to use 4TB / 8TB TLC (triple-layer cell flash memory) SSD products to meet the demanding training process requirements.
The report points out that as more generated information is displayed in videos or photos, the amount of data storage also increases accordingly. Therefore, large-capacity SSDs such as TLC / QLC (quad-layer cell flash memory) 16TB or more have become the main choice for AI inference. product.
In addition to the demand for products above 16TB in the 2024 AI server SSD market, demand has increased significantly since the second quarter. With the arrival of NVIDIA H100, H20 and H200 series products, relevant customers have further increased order demand for TLC 4 and 8TB Enterprise SSDs. . According to estimates by TrendForce, AI-related SSD procurement capacity will exceed 45EB this year (Note from this site: 1EB=1024PB≈1.048 million TB). In the next few years, AI servers are expected to drive the annual growth rate of SSD demand to more than 60% on average, and The proportion of AI SSD demand in the entire NAND Flash (flash memory) is likely to increase from 5% in 2024 to 9% in 2025.
In terms of the supply market, as the trend of using large-capacity SSD products for inference servers remains unchanged, suppliers have begun to accelerate process upgrades and plan to mass-produce products with 2YY/3XX layer processes starting from the first quarter of 2025. And launched the 120TB Enterprise SSD product.
The above is the detailed content of TrendForce: AI SSD procurement capacity is expected to exceed 45EB in 2024, and contract prices will increase by more than 80% in one year. For more information, please follow other related articles on the PHP Chinese website!