人工智能技术在数值天气预报中的应用

孙健; 曹卓; 李恒; 钱思萌; 王昕; 闫力敏; 薛巍

doi:10.11898/1001-7313.20210101

人工智能技术在数值天气预报中的应用

doi: 10.11898/1001-7313.20210101

孙健^1, ,,
曹卓²,
李恒²,
钱思萌³,
王昕²,
闫力敏²,
薛巍^{2, 3, 4, 5}

基金项目:

国家重点研发计划 2017YFA0604500

国家重点研发计划 2016YFA0602100

详细信息

通讯作者:
孙健, sunjian@cma.gov.cn

计量
- 文章访问数: 626
- HTML全文浏览量: 350
- PDF下载量: 1
- 被引次数: 0
出版历程
- 收稿日期: 2020-08-25
- 修回日期: 2020-11-02
- 网络出版日期: 2021-03-31
- 发布日期: 2021-01-27

Application of Artificial Intelligence Technology to Numerical Weather Prediction

Sun Jian^{1
, ,},
Cao Zhuo²,
Li Heng²,
Qian Simeng³,
Wang Xin²,
Yan Limin²,
Xue Wei^{2, 3, 4, 5}

摘要

摘要: 当前，人工智能迎来第3次发展浪潮并在多个领域大数据分析中取得巨大成功，这为人工智能技术与数值天气预报结合提供了契机。已有大量研究尝试将人工智能技术用于数值天气预报的初值生成、预报和产品应用过程中，涉及观测资料预处理、资料同化、模式积分、后处理以及高性能计算，通过误差估计、参数估计和局部代理等手段使预报结果，得到改进且计算速度大幅提升，展示出良好的应用前景，一些神经网络模型也表现出纯数据驱动预报的可能性，在短时强对流天气、降水以及气候预测中已有较为理想的应用实例。然而，人工智能技术在数值天气预报中的应用与发展仍面临一些挑战，主要包括深度学习的弱解释性、不确定性分析以及两者的耦合等，除了应对这些挑战，未来两者的深度结合还需要在理论指导下的人工智能模型设计、高时空分辨率人工智能预报模型设计以及使用更多新型人工智能技术等方面深入探索。
- 数值天气预报 /
- 人工智能 /
- 机器学习 /
- 神经网络
Abstract: Numerical weather prediction technology plays an increasingly important role in improving accuracy and service level of modern weather forecast. With the development of observation system and higher resolution and complexity of the numerical weather prediction model, the products of numerical weather forecast have been greatly improved in quantity and quality, and can offer rich information at high spatial-temporal frequency. However, such a large amount of prediction data are not fully explored. Artificial intelligence has achieved great success in many fields, such as pattern recognition and natural language processing, which provides an opportunity for further improving numerical weather prediction. It's also employed in initialization, numerical model and production of weather forecast service, involving observation system, data assimilation, model integration, ensemble forecast and high-performance computing methods. Both the accuracy of forecast results and computational efficiency have been improved by using error correction, parameter estimation, local surrogate model and so on. In addition, some end-to-end neural network models also show the potential of pure data-driven weather forecast. These models use spatial-temporal observation data as input and directly output the prediction results in terms of deterministic results or probabilities. Some of them perform well in short-term severe convective weather, precipitation, and long-term climate forecast. Existing works employ various artificial intelligence technology methods, mainly including large-scale calculation of neural network, feature analysis, interpretability, and customized loss function. However, there are still some challenges, the potential of artificial intelligence needs to be further explored. Some issues should be carefully considered, including weak interpretability, uncertainty analysis and the coupling with conventional numerical models, and how to use physical knowledge to guide the design of artificial intelligence model is also worth addressing. To deal with these challenges, some promising suggestions are proposed. Bayesian network and causal network will help to establish more comprehensive and profound feature engineering. Using Bayesian inference to generate distribution characteristics of current meteorological states may be an alternative to efficient and effective uncertainty quantification. The development of some standard workflow and framework will contribute to the coupling of conventional numerical model and artificial intelligence module. Successful artificial intelligence applications in weather forecast require deep cooperation between meteorological experts and computer experts who focus on artificial intelligence and high-performance computing.
- numerical weather prediction /
- artificial intelligence /
- machine learning /
- neural networks

HTML全文

图 1 数值天气预报过程示意图

Figure 1. Workflow of numerical weather prediction

下载: 全尺寸图片幻灯片

图 2 人工智能技术组成

Figure 2. Components of artificial intelligence technology

下载: 全尺寸图片幻灯片

图 3 基于人工智能模型的天气预报流程

Figure 3. Weather prediction workflow based on artificial intelligence models

下载: 全尺寸图片幻灯片

表 1 人工智能技术在数值天气预报中的应用

Table 1. Artificial intelligence applications to numerical weather prediction

功能	模块	人工智能技术	目标	效果
初值生成	观测资料处理及质量控制	贝叶斯方案、全卷积网络、极限学习机等	观测偏差纠正^[43]、雷达及卫星图像资料预处理^[44-45]等	提高观测资料质量，优化高分辨率图像资料分割、资料填补等
初值生成	资料同化	随机森林、深度神经网络、支持向量机等	同化算法参数优化^[46]、部分替代资料同化方法^[47]、聚焦观测区域^[48]等	提高同化质量，提高同化速度，更好利用高分辨率资料等
预报	模式积分	深度神经网络、卷积网络、随机森林等	模式代理^[49]、替代物理过程参数化方案^[50-53]、参数校正^[54-55]等	提高模式计算速度，优化次网格物理过程的表示，提高参数校正效果与速度等
产品应用	后处理	随机森林、深度神经网络、卷积神经网络等	确定性及集合预报结果后处理^[56-58]、替代集合预报^[59-60]等	后处理偏差订正、质量更好、效率更高等

下载: 导出CSV

参考文献(71)

[1]	段海来, 千怀遂.广州市城市电力消费对气候变化的响应.应用气象学报, 2009, 20(1):80-87. doi: 10.3969/j.issn.1001-7313.2009.01.010 Duan Hailai, Qian Huaisui.Responses of the electric power consumption to climate change in Guangzhou City.J Appl Meteor Sci, 2009, 20(1):80-87. doi: 10.3969/j.issn.1001-7313.2009.01.010
[2]	郭建平.农业气象灾害监测预测技术研究进展.应用气象学报, 2016, 27(5):620-630. doi: 10.11898/1001-7313.20160510 Guo Jianping.Research progress on agricultural meteorological disaster monitoring and forecasting.J Appl Meteor Sci, 2016, 27(5):620-630. doi: 10.11898/1001-7313.20160510
[3]	王纯枝, 霍治国, 张蕾, 等.北方地区小麦蚜虫气象适宜度预报模型构建.应用气象学报, 2020, 31(3):280-289. doi: 10.11898/1001-7313.20200303 Wang Chunzhi, Huo Zhiguo, Zhang Lei, et al.Construction of forecasting model of meteorological suitability for wheat aphids in the Northern China.J Appl Meteor Sci, 2020, 31(3):280-289. doi: 10.11898/1001-7313.20200303
[4]	周雨, 刘志萍, 张国平.鹰厦铁路降水诱发地质灾害概率预报模型及应用.应用气象学报, 2015, 26(6):743-749. doi: 10.11898/1001-7313.20150611 Zhou Yu, Liu Zhiping, Zhang Guoping.Probability forecasting model of geological disaster along the Yingxia Railway induced by precipitation with its application.J Appl Meteor Sci, 2015, 26(6):743-749. doi: 10.11898/1001-7313.20150611
[5]	侯英雨, 张蕾, 吴门新, 等.国家级现代农业气象业务技术进展.应用气象学报, 2018, 29(6):641-656. doi: 10.11898/1001-7313.20180601 Hou Yingyu, Zhang Lei, Wu Menxin, et al.Advances of modern agrometeorological service and technology in China.J Appl Meteor Sci, 2018, 29(6):641-656. doi: 10.11898/1001-7313.20180601
[6]	高太长, 刘磊, 赵世军, 等.全天空测云技术现状及进展.应用气象学报, 2010, 21(1):101-109. doi: 10.3969/j.issn.1001-7313.2010.01.014 Gao Taichang, Liu Lei, Zhao Shijun, et al.The actuality and progress of whole sky cloud sounding techniques.J Appl Meteor Sci, 2010, 21(1):101-109. doi: 10.3969/j.issn.1001-7313.2010.01.014
[7]	Zhai Panmao, Liu Jing.Extreme weather/climate events and disaster prevention and mitigation under global warming background.Engineering Sciences, 2012, 14(9):55-63.
[8]	穆穆, 陈博宇, 周菲凡, 等.气象预报的方法与不确定性.气象, 2011, 37(1):1-13. Mu Mu, Chen Boyu, Zhou Feifan, et al.Methods and uncertainties of meteorological forecast.Meteorological Monthly, 2011, 37(1):1-13.
[9]	曾晓梅.国外人工智能技术在天气预报中的应用综述.气象科技, 1999, 27(1):4-10. https://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ901.001.htm Zeng Xiaomei.Application of artificial intelligence technology in weather forecast abroad.Meteorological Science and Technology, 1999, 27(1):4-10. https://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ901.001.htm
[10]	Cleveland A.The physical basis of long-range weather forecasts.Mon Wea Rev, 1901, 29(12):551.
[11]	Bjerknes V.Das Problem der Wettervorhersage betrachtet vomStandpunkt der Mechanik und Physik.Meteorol Z, 1904, 21:1-7.
[12]	Richardson L F.Weather Prediction by Numerical Process.Cambridge:Cambridge University Press, 1922.
[13]	Charney J G, Fjoertoft R, Von Neumann J.Numerical integration of the barotropic vorticity equation.Tellus, 1950, 2:237-254.
[14]	Lynch P.The origins of computer weather prediction and climate modeling.J Comput Phys, 2008, 227:3431-3444. doi: 10.1016/j.jcp.2007.02.034
[15]	李泽椿, 陈德辉.国家气象中心集合数值预报业务系统的发展及应用.应用气象学报, 2002, 13(1):1-15. doi: 10.3969/j.issn.1001-7313.2002.01.001 Li Zechun, Chen Dehui.The development and application of the operational ensemble prediction system at National Meteorological Center.J Appl Meteor Sci, 2002, 13(1):1-15. doi: 10.3969/j.issn.1001-7313.2002.01.001
[16]	沈学顺, 苏勇, 胡江林, 等.GRAPES_GFS全球中期预报系统的研发和业务化.应用气象学报, 2017, 28(1):1-10. doi: 10.11898/1001-7313.20170101 Shen Xueshun, Su Yong, Hu Jianglin, et al.Development and operation transformation of GRAPES global middle-range forecast system.J Appl Meteor Sci, 2017, 28(1):1-10. doi: 10.11898/1001-7313.20170101
[17]	贺雅楠, 高嵩, 薛峰, 等.基于MICAPS4的智能网格预报平台设计与实现.应用气象学报, 2018, 29(1):13-24. doi: 10.11898/1001-7313.20180102 He Yanan, Gao Song, Xue Feng, et al.Design and implementation of intelligent grid forecasting platform based on MICAPS4.J Appl Meteor Sci, 2018, 29(1):13-24. doi: 10.11898/1001-7313.20180102
[18]	李泽椿, 毕宝贵, 金荣花, 等.近10年中国现代天气预报的发展与应用.气象学报, 2014, 72(6):1069-1078. doi: 10.3969/j.issn.1004-4965.2014.06.007 Li Zechun, Bi Baogui, Jin Ronghua, et al.The development and application of the modern weather forecast in China for the recent 10 years.Acta Meteorologica Sinica, 2014, 72(6):1069-1078. doi: 10.3969/j.issn.1004-4965.2014.06.007
[19]	Bauer P, Thorpe A, Brunet G.The quiet revolution of numerical weather prediction.Nature, 2015, 525(7567):47-55. doi: 10.1038/nature14956
[20]	Goodfellow I, Bengio Y, Courville A.Deep Learning.Cambridge:MIT Press, 2016.
[21]	Jain A K.Data clustering:50 years beyond k-means.Pattern Recognition Letters, 2009, 31(8):651-666.
[22]	Yang J, Zhang D, Frangi A F, et al.Two-dimensional PCA:A new approach to appearance-based face representation and recognition.IEEE Transactions on Pattem Analysis and Machine Intelligence, 2004, 26(1):131-137. doi: 10.1109/TPAMI.2004.1261097
[23]	周志华.机器学习.北京:清华大学出版社, 2016. Zhou Zhihua.Machine Learning.Beijing:Tsinghua University Press, 2016.
[24]	Hadji I, Wildes R P.What Do We Understand About Convolutional Networks?Preprint at https://arxiv.org/abs/1803.08834,2018:1-94.
[25]	Graves A.Supervised sequence labelling with recurrent neural networks.Studies in Computational Intelligence, 2012, 385:1-131.
[26]	Goodfellow I, Pouget-Abadie J, Mirza M, et al.Generative Adversarial Nets//Proceedings of the 27th International Conference on Neural Information Processing Systems, 2014: 2672-2680.
[27]	Qin Z, Yu F, Liu C, et al.How convolutional neural networks see the world-A survey of convolutional neural network visualization methods.Mathematical Foundations of Computing, 2018, 1(2):149-180. doi: 10.3934/mfc.2018008
[28]	Pearl J, Mackenzie D.The Book of Why.London:Allen Lane, 2019.
[29]	Yosinski J, Clune J, Bengio Y, et al.How Transferable are Features in Deep Neural Networks?//Proceedings of the 27th International Conference on Neural Information Processing Systems, 2014: 3320-3328.
[30]	Akhtar N M A.Threat of adversarial attacks on deep learning in computer vision:A Survey.IEEE Access, 2018, 6:14410-14430. doi: 10.1109/ACCESS.2018.2807385
[31]	Feurer M, Klein A, Eggensperger K, et al.Efficient and robust automated machine learning.Advances in Neural Information Processing Systems, 2016, 28:2944-2952.
[32]	Jin H, Song Q, Hu X.Auto-Keras: An Efficient Neural Architecture Search System//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019: 1946-1956.
[33]	Francois-Lavet V, Henderson P, Islam R, et al.An introduction to deep reinforcement learning.Foundations and Trends in Machine Learning, 2018, 11(3-4), DOI: 10.1561/2200000071.
[34]	Pedregosa F, Varoquaux G, Gramfort A, et al.Scikit-learn:Machine Learning in Python.Journal of Machine Learning Research, 2011, 12:2825-2830.
[35]	Chollet F.Keras(2020-04-28)[2020-06-20].https://keras.io,2020.
[36]	Abadi M, Barham P, Chen Jianmin, et al.TensorFlow: A System for Large-scale Machine Learning//Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation, 2016: 265-283.
[37]	Paszke A, Gross S, Chintala S, et al.Automatic Differentiation in PyTorch//31st Conference on Neural Information Processing Systems, 2017: 1-4.
[38]	Yin S, Ouyang P, Tang S, et al.A high energy efficient reconfigurable hybrid neural network processor for deep learning applications.IEEE Journal of Solid-State Circuits, 2018, 53(4):968-982. doi: 10.1109/JSSC.2017.2778281
[39]	Vazhkudai S, Supinski B R, Bland A S.The Design, Deployment, and Evaluation of the CORAL Pre-exascale Systems//The InternationalConference for High Performance Computing, Networking, Storage, and Analysis, 2018: 661-672.
[40]	Reichstein M, Camps-Valls G, Stevens B, et al.Deep learning and process understanding for data-driven earth system science.Nature, 2019, 566(7743):195-204. doi: 10.1038/s41586-019-0912-1
[41]	Karpatne A, Watkins W, Read J, at al.Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling.Preprint at https://arxiv.org/abs/1710.11431v2,2017:1-11.
[42]	Karpatne A, Atluri G, Faghmous J, et al.Theory-guided data science:A new paradigm for scientific discovery from data.IEEE Transactions on Knowledge & Data Engineering, 2017, 29(10):2318-2331.
[43]	Berry T, Harlim J.Correcting biased observation model error in data assimilation.Mon Wea Re, 2017, 145(7):2833-2853. doi: 10.1175/MWR-D-16-0428.1
[44]	安捷, 马尽文.基于全卷积网络的遥感图像自动云检测.信号处理, 2019, 35(4):556-562. An Jie, Ma Jinwen.Automatic cloud segmentation based on the fully convolutional neural networks.Journal of Signal Processing, 2019, 35(4):556-562.
[45]	Chang Nibin, Bai Kaixu, Chen Chifarn.Smart information reconstruction via time-space-spectrum continuum for cloud removal in satellite images.IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(5):1898-1912. doi: 10.1109/JSTARS.2015.2400636
[46]	Moosavi A, Attia A, Sandu A.A Machine Learning Approach to Adaptive Covariance Localization.Preprint at https://arxiv.org/abs/1801.00548,2018:1-24.
[47]	Cintra R, de Campos Velho H, Cocke S.Tracking the Model: Data Assimilation by Artificial Neural Network//2016 International Joint Conference on Neural Networks(IJCNN), 2016: 403-410.
[48]	Lee Y J, Hall D, Stewart J, et al.Machine learning for targeted assimilation of satellite data.Machine Learning and Knowledge Discovery in Databases, 2018, 11053:53-68.
[49]	Scher S.Toward data-driven weather and climate forecasting approximating a simple general circulation model with deep learning.Geophys Res Lett, 2018, 45(22):12616-12622. doi: 10.1029/2018GL080704
[50]	Brenowitz N D, Bretherton C S.Prognostic validation of a neural network unified physics parameterization.Geophys Res Lett, 2018, 45:6289-6298. doi: 10.1029/2018GL078510
[51]	Pan B, Hsu K, AghaKouchak A, et al.Improving precipitation estimation using convolutional neural network.Water Resources Research, 2019, 55(3):2301-2321. doi: 10.1029/2018WR024090
[52]	O'Gorman P A, Dwyer J G.Using machine learning to parameterize moist convection:Potential for modeling of climate, climate change, and extreme events.Journal of Advances in Modeling Earth Systems, 2018, 10(10):2548-2563. doi: 10.1029/2018MS001351
[53]	Rasp S, Pritchard M S, Gentine P.Deep learning to represent subgrid processes in climate models.Proceedings of the National Academy of Sciences, 2018, 115(39):9684-9689. doi: 10.1073/pnas.1810286115
[54]	Xu H, Zhang T, Luo Y, et al.Parameter calibration in global soil carbon models using surrogate-based optimization.Geoscientific Model Development, 2018, 11(7):3027-3044. doi: 10.5194/gmd-11-3027-2018
[55]	Wu L, Zhang T, Qin Y, et al.An effective parameter optimization with radiation balance constraint in CAM5.Geophys Res Lett, 2020, 13:41-53.
[56]	Burke A.Calibration of machine learning-based probabilistic hail predictions for operational forecasting.Bull Amer Meteor Soc, 2020, 35:149-168.
[57]	Taillardat M.Calibrated ensemble forecasts using quantile regression forests and ensemble model output statistics.Mon Wea Rev, 2016, 144(6):2375-2393. doi: 10.1175/MWR-D-15-0260.1
[58]	Rasp S, Lerch S.Neural networks for postprocessing ensemble weather forecasts.Mon Wea Rev, 2018, 146(11):3885-3900. doi: 10.1175/MWR-D-18-0187.1
[59]	Scher S, Messori G.Predicting weather forecast uncertainty with machine learning.Quart J Roy Meteor Soc, 2018, 144(717):2830-2841. doi: 10.1002/qj.3410
[60]	Sonderby C K, Espeholt L, Heek J, et al.MetNet: A Neural Weather Model for Precipitation Forecasting.Preprint at https://arxiv.org/abs/2003.12140,2020:1-17.
[61]	Ham Y G, Kim J H, Luo J J.Deep learning for multi-year ENSO forecasts.Nature, 2019, 573(7775):568-572. doi: 10.1038/s41586-019-1559-7
[62]	Zhou K, Zheng Y, Li B, et al.Forecasting different types of convective weather:a deep learning approach.J Meteor Res, 2019, 33(5):797-809. doi: 10.1007/s13351-019-8162-6
[63]	Kurth T, Treichler S, Romero J, et al.Exascale Deep Learning for Climate Analytics//Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis, 2018: 1-12.
[64]	Rojek K.Machine learning method for energy reduction by utillzing dynamic mixed precision on GPU-based supercomputers.Concurrency and Computation:Practice and Experience, 2019, 31(6):e4644.1-e4644.12.
[65]	Manandhar S, Dev S, Lee Y H, et al.A data-driven approach for accurate rainfall prediction.IEEE Trans Geosci Remote Sens, 2019, 57(11):9323-9331. doi: 10.1109/TGRS.2019.2926110
[66]	Gagne D, Haupt S, Nychka D, et al.Interpretable deep learning for spatial analysis of severe hailstorms.Mon Wea Rev, 2019, 147(8):2827-2845. doi: 10.1175/MWR-D-18-0316.1
[67]	Karevan Z, Suykens J.Transductive LSTM for time-series prediction:An application to weather forecasting.Neural Networks, 2020, 125:1-9. doi: 10.1016/j.neunet.2019.12.030
[68]	Qiu M, Zhao P, Zhang K, et al.A Short-term Rainfall Prediction Model Using Multi-task Convolutional Neural Networks//2017 IEEE International Conference on Data Mining, 2017: 395-404.
[69]	Yuan M, Ji X, Lu T, et al.A Novel Two-Factor Attention Encoder-Decoder Network through Combining Temporal and Prior Knowledge for Weather Forecasting//2019 International Joint Conference on Neural Networks, 2019: 1-8.
[70]	Prasetya E P, Djamal E C.Rainfall Forecasting for the Natural Disasters Preparation Using Recurrent Neural Networks//2019 International Conference on Electrical Engineering and Informatics, 2019: 52-57.
[71]	Tan C, Feng X, Long J, et al.FORECAST-CLSTM: A New Convolutional LSTM Network for Cloudage Nowcasting//2018 IEEE Visual Communications and Image Processing, 2018: 1-4.