Technology peripherals
AI
The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan
The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan
ChatGPT’s continued popularity has led to a chip shortage: there is not enough computing power to handle ChatGPT’s computing needs, which has overloaded OpenAI’s servers. The last large-scale chip shortage was caused by crazy mining for virtual currencies. However, as the demand for generative artificial intelligence continues to increase, this time the computing power shortage may continue for quite some time.
Microsoft hopes to fill this gap with a new virtual machine product called ND H100 v5, which includes a large number of Nvidia code-named Hopper The latest H100 GPU, for generative artificial intelligence applications.
The idea is to provide higher computing speeds to companies working on generative artificial intelligence, which can dig deeper into data, build relationships, reason and predict answers. Generative AI is still in its early stages, but the popularity of apps like ChatGPT is already demonstrating the technology’s potential.
But this technology also requires huge computing power, and Microsoft is introducing it into Azure cloud services.
The virtual machine offering can be scaled to the size of generative AI applications and scales to thousands of H100 GPUs, which are interconnected via the chipmaker's Quantum-2 InfiniBand technology.
Pricing for H100 virtual machines on Azure was not immediately announced. The price of virtual machines varies depending on the configuration, with a fully loaded A100 virtual machine with 96 CPU cores, 900GB of storage, and eight A100 GPUs costing nearly $20,000 per month.
When ChatGPT was first launched last year, Nvidia GPU faced a severe test. Its calculations are undertaken by the OpenAI supercomputer, which is built with Nvidia A100 GPUs.
But the server was quickly overwhelmed by the crazy increase in demand for ChatGPT, and users complained that the server could not respond and process query tasks in time.
The H100 could close the speed gap needed for generative artificial intelligence, which is already used in healthcare, robotics and other industries. Various development companies are also looking to fill the last mile gap and deploy an interface to make AI simple and usable, like ChatGPT.
Nvidia and Microsoft are already using the H100 to build an artificial intelligence supercomputer. The GPU is designed to work best with applications coded in CUDA (CUDA is Nvidia's parallel programming framework). Products also include the Triton inference server, which will help deploy artificial intelligence model GPT-3 on its GPU environment.
Microsoft began to fully embed artificial intelligence in its products: it implemented a customized version of GPT-3.5, the large language model behind ChatGPT, in the Bing search engine. Microsoft is taking a DevOps (development operations) style iterative approach to Bing AI, in which applications can be quickly updated by learning about users as they use the model. Microsoft 365 Copilot is the original OFFICE suite with embedded artificial intelligence. Familiar software such as WORD, PPT and EXCEL will change traditional working methods with new capabilities. And behind all this, it is inseparable from the support of computing power.
The new Azure virtual machine base configuration interconnects eight H100 Tensor Core GPUs via NVIDIA’s proprietary NVLink 4.0 interconnect. This configuration can be scaled to additional GPUs via the Quantum-2 interconnect. The server features Intel's 4th generation Xeon (Sapphire Rapids) scalable processors, with data transfer to and from the GPU via PCIe Gen5.
The above is the detailed content of The artificial intelligence boom has led to a shortage of computing power, Microsoft launches a new server rental plan. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
AI Hentai Generator
Generate AI Hentai for free.
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
ChatGPT now allows free users to generate images by using DALL-E 3 with a daily limit
Aug 09, 2024 pm 09:37 PM
DALL-E 3 was officially introduced in September of 2023 as a vastly improved model than its predecessor. It is considered one of the best AI image generators to date, capable of creating images with intricate detail. However, at launch, it was exclus
Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions
Jun 28, 2024 am 03:51 AM
This site reported on June 27 that Jianying is a video editing software developed by FaceMeng Technology, a subsidiary of ByteDance. It relies on the Douyin platform and basically produces short video content for users of the platform. It is compatible with iOS, Android, and Windows. , MacOS and other operating systems. Jianying officially announced the upgrade of its membership system and launched a new SVIP, which includes a variety of AI black technologies, such as intelligent translation, intelligent highlighting, intelligent packaging, digital human synthesis, etc. In terms of price, the monthly fee for clipping SVIP is 79 yuan, the annual fee is 599 yuan (note on this site: equivalent to 49.9 yuan per month), the continuous monthly subscription is 59 yuan per month, and the continuous annual subscription is 499 yuan per year (equivalent to 41.6 yuan per month) . In addition, the cut official also stated that in order to improve the user experience, those who have subscribed to the original VIP
Context-augmented AI coding assistant using Rag and Sem-Rag
Jun 10, 2024 am 11:08 AM
Improve developer productivity, efficiency, and accuracy by incorporating retrieval-enhanced generation and semantic memory into AI coding assistants. Translated from EnhancingAICodingAssistantswithContextUsingRAGandSEM-RAG, author JanakiramMSV. While basic AI programming assistants are naturally helpful, they often fail to provide the most relevant and correct code suggestions because they rely on a general understanding of the software language and the most common patterns of writing software. The code generated by these coding assistants is suitable for solving the problems they are responsible for solving, but often does not conform to the coding standards, conventions and styles of the individual teams. This often results in suggestions that need to be modified or refined in order for the code to be accepted into the application
Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations
Jun 11, 2024 pm 03:57 PM
Large Language Models (LLMs) are trained on huge text databases, where they acquire large amounts of real-world knowledge. This knowledge is embedded into their parameters and can then be used when needed. The knowledge of these models is "reified" at the end of training. At the end of pre-training, the model actually stops learning. Align or fine-tune the model to learn how to leverage this knowledge and respond more naturally to user questions. But sometimes model knowledge is not enough, and although the model can access external content through RAG, it is considered beneficial to adapt the model to new domains through fine-tuning. This fine-tuning is performed using input from human annotators or other LLM creations, where the model encounters additional real-world knowledge and integrates it
To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework
Jul 25, 2024 am 06:42 AM
Editor |ScienceAI Question Answering (QA) data set plays a vital role in promoting natural language processing (NLP) research. High-quality QA data sets can not only be used to fine-tune models, but also effectively evaluate the capabilities of large language models (LLM), especially the ability to understand and reason about scientific knowledge. Although there are currently many scientific QA data sets covering medicine, chemistry, biology and other fields, these data sets still have some shortcomings. First, the data form is relatively simple, most of which are multiple-choice questions. They are easy to evaluate, but limit the model's answer selection range and cannot fully test the model's ability to answer scientific questions. In contrast, open-ended Q&A
SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time
Jul 17, 2024 pm 06:37 PM
Editor | KX In the field of drug research and development, accurately and effectively predicting the binding affinity of proteins and ligands is crucial for drug screening and optimization. However, current studies do not take into account the important role of molecular surface information in protein-ligand interactions. Based on this, researchers from Xiamen University proposed a novel multi-modal feature extraction (MFE) framework, which for the first time combines information on protein surface, 3D structure and sequence, and uses a cross-attention mechanism to compare different modalities. feature alignment. Experimental results demonstrate that this method achieves state-of-the-art performance in predicting protein-ligand binding affinities. Furthermore, ablation studies demonstrate the effectiveness and necessity of protein surface information and multimodal feature alignment within this framework. Related research begins with "S
ChatGPT is now available for macOS with the release of a dedicated app
Jun 27, 2024 am 10:05 AM
Open AI’s ChatGPT Mac application is now available to everyone, having been limited to only those with a ChatGPT Plus subscription for the last few months. The app installs just like any other native Mac app, as long as you have an up to date Apple S
SK Hynix will display new AI-related products on August 6: 12-layer HBM3E, 321-high NAND, etc.
Aug 01, 2024 pm 09:40 PM
According to news from this site on August 1, SK Hynix released a blog post today (August 1), announcing that it will attend the Global Semiconductor Memory Summit FMS2024 to be held in Santa Clara, California, USA from August 6 to 8, showcasing many new technologies. generation product. Introduction to the Future Memory and Storage Summit (FutureMemoryandStorage), formerly the Flash Memory Summit (FlashMemorySummit) mainly for NAND suppliers, in the context of increasing attention to artificial intelligence technology, this year was renamed the Future Memory and Storage Summit (FutureMemoryandStorage) to invite DRAM and storage vendors and many more players. New product SK hynix launched last year
