AMD premieres Instinct MI300X GPU: Designed for large language models and AI computing

According to news on June 16, AMD demonstrated its latest Instinct MI300X at the data center and AI technology premiere held on Tuesday. GPU. AMD's keynote speech did not reveal too many details, but according to Hoang Anh Phu found that the overall power consumption (TBP) of the MI300X is 750 watts, while the TBP of the previous generation MI250X was only 500-560 watts.

According to the editor’s understanding, MI300X is a pure GPU version, using AMD CDNA 3 technology and equipped with up to 192 GB of HBM3 high-bandwidth memory, designed to accelerate large language models and generative AI calculations.

MI300X and its CDNA architecture are designed for large language models and other advanced AI models. It packages 12 5nm chips together with a total of 153 billion transistors.

This new AI chip abandons the APU’s 24 Zen cores and I/O chips, and instead uses more CDNA 3 GPUs and a larger 192GB HBM3, providing 5.2 TB/s memory bandwidth and 896GB/s unlimited bandwidth. The release of MI300X will bring more powerful computing capabilities to the data center and AI fields, accelerating the processing and analysis of various complex tasks.

AMD’s latest GPU display has attracted the attention of the industry, and people are full of expectations for the performance of MI300X in large language models and AI calculations. The powerful performance and high-bandwidth memory of this GPU will help further promote the development of AI technology and provide more efficient computing solutions for data centers.

Although AMD did not reveal more details at the premiere, the release of MI300X marks AMD’s continued innovation and progress in the data center and AI fields. As technology continues to evolve, we can expect AMD to launch more innovative products in the future to help promote the development of artificial intelligence and bring more applications and opportunities to various industries.

The above is the detailed content of AMD premieres Instinct MI300X GPU: Designed for large language models and AI computing. For more information, please follow other related articles on the PHP Chinese website!