Machine learning makes Computer Graphics (CG) simulation more realistic!
The method is called Neural Flow Maps (Neural Flow Maps, NFM), which can accurately simulate the smoke of four vortices Type:
More complex ones can also be easily implemented:
You must know that in this AI application, there are so many In this era, CG physics simulation is still dominated by traditional numerical algorithms.
Although the application of neural networks in CG can create dazzling visual effects, it cannot be rigorous and robust describe physical properties.
It is precisely for this reason that physical simulation based on neural networks is still in proof of concept (proof of concept) stage, the effect generated is far from SOTA.
To solve this complex problem, a research team from Dartmouth College, Georgia Institute of Technology, and Stanford University proposed a new method called neural flow diagram. They combined the advantages of neural networks with advanced physical models to achieve unprecedented visual effects and physical accuracy.
This paper was published in the top journal ACM Transactions on Graphics (TOG), and won the best paper of SIGGRAPH Asia 2023.
The core point of view of the research team is: if you want to use AI to better solve physical problems, you cannot limitly embed learnable modules into existing method frameworks (such as SPH, stable fluids) in.
Existing methods are tailored to the capabilities of traditional numerical methods. Because of this, the development of machine learning has proposed a series of new capabilities(such as NeRF's analysis of spatiotemporal signals) Compact expression) often cannot be found in existing frameworks.
Therefore, researchers believe that instead of applying AI to the existing framework, it is better to design a new mathematical and numerical framework based on the new capabilities proposed by AI to maximize the value of these capabilities. Physical modelBased on the above ideas, the researchers built a model beyond SOTA throughco-design(co-design) of physics and AI fluid simulator.
In the physics part, NFM first uses a set of impulse-basedfluid equations, by performing gauge transformation on the common Euler equation (gauge transformation) , the relationship between the velocity field and the flow map (flow map) and its spatial derivative is established. In other words, as long as an accurate numerical solution to the flow map can be obtained, the evolving velocity field can be accurately reconstructed.
In order to calculate the flow map most accurately, NFM proposes a carefully designed "bidirectional marching"
(bidirectional marching)numerical algorithm. This algorithm is 3 to 5 orders of magnitude more accurate than existing algorithms, but it also requires the storage of long-term spatiotemporal
velocity fields.For large-scale 3D simulations, it is still challenging to store the velocity field of a single frame, but it is completely unfeasible to store the velocity field of tens or hundreds of frames. Therefore, although the "two-way travel" algorithm is accurate, it cannot be realized using traditional means.
Neural Network Storage
NFM cleverly combines the flow graph-based physical model’s need to store high-precision velocity fields with implicit neural representationINR usually only needs to be trained once for each scenario, but NFM uses it as an intermediate variable to continuously update during the simulation process. This It also puts forward more stringent requirements on the performance of INR.
In response to this, NFM proposes a new high-performance INR called SSNF.
By automatically planning the opening state of each grid point in spatial sparse storage, and a time processing scheme based on Lagrange polynomials, SSNF achieves faster convergence speed and higher than Instant-NGP, KPlanes and other methods. compression ratio and higher storage accuracy.
The experimental results show that as an AI-based simulator, NFM significantly surpasses the SOTA method: bimocq, covector fluids and MC R.
In the experiment where 2D point vortex (point vortex) was maintained, the average absolute error of NFM was reduced by at least 14 and at most 308 times compared with the other three.
In the 3D leapfrogging vortices experiment, NFM also significantly improved the ability to conserve energy.
At the same time, this numerical capability is reflected in a better simulation of natural phenomena: according to the laws of physics, the two pairs of vortex tubes in the frog leap will never merge, while NFM The two vortex tubes still remain separated after completing 5 frog leaps, while the comparison method completely merges after at most 3 times. Finally, the article also demonstrates through a series of calculation examples(such as solid interaction, Rayleigh Taylor instability, vortex tube reconnection, etc.) NFM's superiority in creating complex visual effects.
It is worth noting at this level that although AI is used to give more details to the fluid, the existing AI super-resolution algorithm can only improve the picture details, but NFM has a breakthrough in using physical This method improves dynamic details, thereby fundamentally improving the realism of fluid simulations.Project link: https://yitongdeng-projects.github.io/neural_flow_maps_webpage/
The above is the detailed content of AI simulator takes the new SOTA in physics simulation!. For more information, please follow other related articles on the PHP Chinese website!