Table of Contents
Why is it listed as a scientific problem?
Nowcasting large model NowcastNet
△Meteorological expert inspection results and numerical index evaluation results, CSI is used to measure the position accuracy of the forecast; PSD is used to measure the spectrum of the forecast Comparison between characteristics and radar observed precipitation variability.
△a. Predicted geographical information, b. Prediction results of different models at T 1 hour, T 2 hours and T 3 hours , c. CSI is an indicator used to evaluate the accuracy of predictions
Team Information
Home Technology peripherals AI Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, 'ghost weather' forecast timeliness reaches 3 hours for the first time

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, 'ghost weather' forecast timeliness reaches 3 hours for the first time

Jul 17, 2023 am 11:45 AM
Model weather nature

Really "prepare for a rainy day", Tsinghua University's "ghost weather" forecast model is here!

It is the kind that can solve the world's unsolved problems -

It can predict extreme precipitation from 0 to 3 hours at the kilometer scale.

Extreme precipitation weather, including short-term heavy precipitation, storms, blizzards, hail, etc., can provide early warning.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first timePicture

Completing this research was not easy.

The School of Software of Tsinghua University cooperated with the National Meteorological Center and the National Meteorological Information Center. It took three years of joint research to propose this large extreme precipitation nowcasting model called NowcastNet, and it took nearly six years of radar observation data to complete it. Model training.

In the process test of 62 weather forecast experts across the country, this method is significantly ahead of similar methods in the world, and the research results have now been published in Nature.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first timePicture

Currently, NowcastNet has been deployed and launched on the National Meteorological Center’s short-term forecast business platform (SWAN 3.0), which will provide information for the national extreme precipitation weather short-term Provide support for forecasting operations.

So why is nowcasting of extreme precipitation so difficult? How did the Tsinghua team solve this problem?

Why is it listed as a scientific problem?

In recent years, due to the influence of global climate change, extreme precipitation weather has occurred frequently. Precipitation nowcasting that is more accurate, more precise and has longer warning lead time has become a focus of people's attention.

Since most extreme precipitation weather processes only last for tens of minutes and have a spatial scale of several kilometers, they are severely affected by complex processes such as convection, cyclones, topography, and chaotic effects of the atmospheric system.

However, numerical prediction technology based on physical equation simulation is difficult to effectively predict kilometer-scale extreme precipitation.

Therefore, at the World Meteorological Organization Summit on May 27 this year, precipitation nowcasting within three hours was listed as one of the important unsolved scientific problems.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first time△Precipitation nowcasting based on radar observations is one of the world's difficult problems

There have been methods for predicting extreme precipitation weather before.

Numerical calculation and deep learning are the two mainstream methods of precipitation nowcasting, but both have obvious flaws:

Numerical calculation methods are difficult to effectively model the spatiotemporal multi-scale characteristics of the precipitation process. Restricted by cumulative forecast errors, the forecast timeliness is often within one hour.

Although deep learning methods are good at modeling nonlinear systems, statistical models have inherent small-sample over-smoothing problems. The prediction solution process lacks physical conservation law constraints, and the generated numerical fields have severe blur and distortion, making it difficult to provide services. Value of extreme precipitation forecasts.

Nowcasting large model NowcastNet

In response to the above challenges, since 2017, the team of Professor Wang Jianmin and Associate Professor Long Mingsheng of the School of Software of Tsinghua University has established a research team with the National Meteorological Center and the National Meteorological Information Center. Cooperate on the application of artificial intelligence technology in meteorological big data.

After three years of joint research, the nowcasting large model NowcastNet was proposed and trained on radar observation data from the United States and China in the past six years.

The core of this model is the neural evolution operator for end-to-end modeling of the physical process of precipitation, which achieves the seamless integration of deep learning and physical laws.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first time△NowcastNet, a large nowcasting model that integrates physical modeling and deep learning

Specifically, the research team first designed a mesoscale evolution network, using In order to model mesoscale precipitation processes with more significant physical properties such as advection motion, and based on the material continuity equation (i.e., the law of conservation of mass), a neuroevolution operator was designed to simulate the ten-kilometer scale motion in the precipitation process end-to-end, and through Backpropagation minimizes the cumulative forecast error.

Secondly, the research team proposed a convective scale generation network. Based on the prediction results of the mesoscale evolution network, the probabilistic generation model is used to further capture the kilometer-scale precipitation process in which chaotic effects such as convection generation and dissipation are more significant.

Thanks to the above-mentioned fusion design, this model combines the advantages of deep learning and physical modeling, and is the first time in the world to extend the timeliness of precipitation nowcasting to 3 hours (mentioned above, the previous numerical calculation method Usually within 1 hour) and make up for the shortcomings of extreme precipitation forecasting.

In order to fully test the operational guidance value of the nowcasting large model NowcastNet for typical weather processes, the National Meteorological Center invited 62 frontline forecasting experts from 23 provincial and municipal meteorological stations to conduct a survey on 2,400 extreme precipitation processes in China and the United States. A posteriori and a priori tests are performed and compared with methods currently used in business.

The forecast system currently widely used by meteorological centers around the world includes the advection-based pySTEPS method. PredRNN is a data-driven neural network that has been deployed at the China Meteorological Administration. The DGMR model was proposed by Google DeepMind in cooperation with the British Met Office.

All models are trained and tested on a large radar dataset of precipitation events in the United States and China.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first timePicture

△Meteorological expert inspection results and numerical index evaluation results, CSI is used to measure the position accuracy of the forecast; PSD is used to measure the spectrum of the forecast Comparison between characteristics and radar observed precipitation variability.

As shown in the figure above, NowcastNet comprehensively surpasses existing technologies in numerical indicators such as Critical Success Index (CSI) and Power Spectral Density (PSD), and is considered to have the highest forecast in 71% of weather processes. value.

In the process of extreme precipitation, NowcastNet is the only nowcasting technology that shows strong business value.

Take the typical extreme weather processes in China and the United States as an example:

At 23:40 on May 14, 2021, a heavy precipitation process occurred in the Jianghuai region of China, Hubei, Anhui and other places The region has issued a red warning for heavy rainfall, and NowcastNet can accurately predict the changing process of three heavy precipitation supercells.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first timePicture

△a. Predicted geographical information, b. Prediction results of different models at T 1 hour, T 2 hours and T 3 hours , c. CSI is an indicator used to evaluate the accuracy of predictions

At 9:30 on December 11, 2021, a tornado disaster occurred in the central United States, killing 89 people and injuring 676 people. NowcastNet It can provide clearer and more accurate forecast results for the intensity, landing area and movement pattern of heavy precipitation.

Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, ghost weather forecast timeliness reaches 3 hours for the first timePicture

The inspection shows that NowcastNet has good guiding significance for the precise prevention and control of extreme disaster weather.

Currently, the research results are published in Nature under the title "Skilful Nowcasting of Extreme Precipitation with NowcastNet", and are also published by Nature News and Viewpoint" reported on "The Outlook for AI Weather Prediction".

The researchers believe:

This research explores a new paradigm of data-driven and physics-driven "scientific learning" and proposes a method for modeling and predicting the space-time material field under the constraints of physical conservation. The general method also has application prospects for other problems with multi-scale physical properties.

They also said:

In the future, the application of this solution will be further promoted in scenarios such as physical problem solving, atmosphere and ocean simulation, and industrial design simulation.

Team Information

Professor Wang Jianmin and Associate Professor Long Mingsheng of the School of Software, Tsinghua University, as well as machine learning expert Michael I. Jordan, professor at the University of California, Berkeley, and honorary professor at Tsinghua University, are the authors of the paper. Corresponding Author.

Ph.D. students Zhang Yuchen and Associate Professor Long Mingsheng from the School of Software, Tsinghua University are the first authors of the paper. Master students Chen Kaiyuan and Xing Lanxiang participated in the research work.

Researcher Jin Ronghua of the National Meteorological Center provided meteorological knowledge and data support and presided over the inspection work of meteorological experts nationwide. Experts such as Luo Bing, Zhang Xiaoling, Xue Feng, Sheng Jie, Han Feng, and Zhang Xiaowen provided support for the research work. Guidance, advice and assistance.

This research was supported by the National Natural Science Foundation of China’s Innovative Research Group Project, the Outstanding Youth Science Fund Project, and the National Engineering Research Center for Big Data System Software.

Paper link: https://www.nature.com/articles/s41586-023-06184-4

The above is the detailed content of Tsinghua University and China Meteorological Administration large model appears in Nature: Solving world-class problems, 'ghost weather' forecast timeliness reaches 3 hours for the first time. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
WWE 2K25: How To Unlock Everything In MyRise
4 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

The world's most powerful open source MoE model is here, with Chinese capabilities comparable to GPT-4, and the price is only nearly one percent of GPT-4-Turbo The world's most powerful open source MoE model is here, with Chinese capabilities comparable to GPT-4, and the price is only nearly one percent of GPT-4-Turbo May 07, 2024 pm 04:13 PM

Imagine an artificial intelligence model that not only has the ability to surpass traditional computing, but also achieves more efficient performance at a lower cost. This is not science fiction, DeepSeek-V2[1], the world’s most powerful open source MoE model is here. DeepSeek-V2 is a powerful mixture of experts (MoE) language model with the characteristics of economical training and efficient inference. It consists of 236B parameters, 21B of which are used to activate each marker. Compared with DeepSeek67B, DeepSeek-V2 has stronger performance, while saving 42.5% of training costs, reducing KV cache by 93.3%, and increasing the maximum generation throughput to 5.76 times. DeepSeek is a company exploring general artificial intelligence

AI subverts mathematical research! Fields Medal winner and Chinese-American mathematician led 11 top-ranked papers | Liked by Terence Tao AI subverts mathematical research! Fields Medal winner and Chinese-American mathematician led 11 top-ranked papers | Liked by Terence Tao Apr 09, 2024 am 11:52 AM

AI is indeed changing mathematics. Recently, Tao Zhexuan, who has been paying close attention to this issue, forwarded the latest issue of "Bulletin of the American Mathematical Society" (Bulletin of the American Mathematical Society). Focusing on the topic "Will machines change mathematics?", many mathematicians expressed their opinions. The whole process was full of sparks, hardcore and exciting. The author has a strong lineup, including Fields Medal winner Akshay Venkatesh, Chinese mathematician Zheng Lejun, NYU computer scientist Ernest Davis and many other well-known scholars in the industry. The world of AI has changed dramatically. You know, many of these articles were submitted a year ago.

Hello, electric Atlas! Boston Dynamics robot comes back to life, 180-degree weird moves scare Musk Hello, electric Atlas! Boston Dynamics robot comes back to life, 180-degree weird moves scare Musk Apr 18, 2024 pm 07:58 PM

Boston Dynamics Atlas officially enters the era of electric robots! Yesterday, the hydraulic Atlas just "tearfully" withdrew from the stage of history. Today, Boston Dynamics announced that the electric Atlas is on the job. It seems that in the field of commercial humanoid robots, Boston Dynamics is determined to compete with Tesla. After the new video was released, it had already been viewed by more than one million people in just ten hours. The old people leave and new roles appear. This is a historical necessity. There is no doubt that this year is the explosive year of humanoid robots. Netizens commented: The advancement of robots has made this year's opening ceremony look like a human, and the degree of freedom is far greater than that of humans. But is this really not a horror movie? At the beginning of the video, Atlas is lying calmly on the ground, seemingly on his back. What follows is jaw-dropping

KAN, which replaces MLP, has been extended to convolution by open source projects KAN, which replaces MLP, has been extended to convolution by open source projects Jun 01, 2024 pm 10:03 PM

Earlier this month, researchers from MIT and other institutions proposed a very promising alternative to MLP - KAN. KAN outperforms MLP in terms of accuracy and interpretability. And it can outperform MLP running with a larger number of parameters with a very small number of parameters. For example, the authors stated that they used KAN to reproduce DeepMind's results with a smaller network and a higher degree of automation. Specifically, DeepMind's MLP has about 300,000 parameters, while KAN only has about 200 parameters. KAN has a strong mathematical foundation like MLP. MLP is based on the universal approximation theorem, while KAN is based on the Kolmogorov-Arnold representation theorem. As shown in the figure below, KAN has

Google is ecstatic: JAX performance surpasses Pytorch and TensorFlow! It may become the fastest choice for GPU inference training Google is ecstatic: JAX performance surpasses Pytorch and TensorFlow! It may become the fastest choice for GPU inference training Apr 01, 2024 pm 07:46 PM

The performance of JAX, promoted by Google, has surpassed that of Pytorch and TensorFlow in recent benchmark tests, ranking first in 7 indicators. And the test was not done on the TPU with the best JAX performance. Although among developers, Pytorch is still more popular than Tensorflow. But in the future, perhaps more large models will be trained and run based on the JAX platform. Models Recently, the Keras team benchmarked three backends (TensorFlow, JAX, PyTorch) with the native PyTorch implementation and Keras2 with TensorFlow. First, they select a set of mainstream

Tesla robots work in factories, Musk: The degree of freedom of hands will reach 22 this year! Tesla robots work in factories, Musk: The degree of freedom of hands will reach 22 this year! May 06, 2024 pm 04:13 PM

The latest video of Tesla's robot Optimus is released, and it can already work in the factory. At normal speed, it sorts batteries (Tesla's 4680 batteries) like this: The official also released what it looks like at 20x speed - on a small "workstation", picking and picking and picking: This time it is released One of the highlights of the video is that Optimus completes this work in the factory, completely autonomously, without human intervention throughout the process. And from the perspective of Optimus, it can also pick up and place the crooked battery, focusing on automatic error correction: Regarding Optimus's hand, NVIDIA scientist Jim Fan gave a high evaluation: Optimus's hand is the world's five-fingered robot. One of the most dexterous. Its hands are not only tactile

FisheyeDetNet: the first target detection algorithm based on fisheye camera FisheyeDetNet: the first target detection algorithm based on fisheye camera Apr 26, 2024 am 11:37 AM

Target detection is a relatively mature problem in autonomous driving systems, among which pedestrian detection is one of the earliest algorithms to be deployed. Very comprehensive research has been carried out in most papers. However, distance perception using fisheye cameras for surround view is relatively less studied. Due to large radial distortion, standard bounding box representation is difficult to implement in fisheye cameras. To alleviate the above description, we explore extended bounding box, ellipse, and general polygon designs into polar/angular representations and define an instance segmentation mIOU metric to analyze these representations. The proposed model fisheyeDetNet with polygonal shape outperforms other models and simultaneously achieves 49.5% mAP on the Valeo fisheye camera dataset for autonomous driving

Single card running Llama 70B is faster than dual card, Microsoft forced FP6 into A100 | Open source Single card running Llama 70B is faster than dual card, Microsoft forced FP6 into A100 | Open source Apr 29, 2024 pm 04:55 PM

FP8 and lower floating point quantification precision are no longer the "patent" of H100! Lao Huang wanted everyone to use INT8/INT4, and the Microsoft DeepSpeed ​​team started running FP6 on A100 without official support from NVIDIA. Test results show that the new method TC-FPx's FP6 quantization on A100 is close to or occasionally faster than INT4, and has higher accuracy than the latter. On top of this, there is also end-to-end large model support, which has been open sourced and integrated into deep learning inference frameworks such as DeepSpeed. This result also has an immediate effect on accelerating large models - under this framework, using a single card to run Llama, the throughput is 2.65 times higher than that of dual cards. one

See all articles