Scatheless Compression Encoding for Meteorological Grid Data Based on BP Neural Network
Received date: 2007-10-09
Revised date: 2008-01-08
Online published: 2008-02-10
Grid data is the main form used in meteorological data storing, transmitting and applying. Along with wide application of global high resolution numerical models, data size is increasing explosively. It brings huge pressure to data storing, transmitting and managing. Designing a compression scheme which is suitable for grid data is becoming more and more important. Presently, most widely used grid data coding schemes are GRIB and netCDF, which are established by WMO. GRIB is specially used in coding meteorological grid data, and it is standard encoding for the form-driven format promoted by WMO. Although GRIB possesses a certain compression ability, less attention is paid to storing efficiency, and the compression ratio is unsatisfactory.
Atmosphere is a kind of continuous medium, the physical quantity describing its dynamic and thermodynamic properties are also continuous. Grid data are results of sampling and quantization of continuous variables, so the correlation between neighboring grid data is very high. In other words, there exists much information redundancy, and the data is compressible.
In this paper, BP neural network is introduced based on the idea of 2-dimensions liner prediction. Using its great ability to simulate nonlinear information, a secondary predictive model for meteorology grid data is established to reduce information redundancy to the minimum. This model can eliminate most correlation. By combining entropy encoding, a new scatheless and highly efficient compression scheme is designed to deal with meteorological grid data.
By using the new scheme, the compression ratio for general meteorology grid data can be effectively promoted, and the compressing process of data is completely scatheless within available precision. A set of contrast experiment between netCDF and the new scheme proved that the compression efficiency of the new scheme is evidently superior to that of netCDF. Its compression ratio is 3 to 5 times as large as netCDF's and is close to the lower limit in theory. The storage space and transmission time all can be extremely reduced by using this scheme. The new compression encoding scheme may be widely used to treat with the vast data in meteorology and other earth sciences.
Zhao Suxuan,Luo Jian,Yang Chengyin . Scatheless Compression Encoding for Meteorological Grid Data Based on BP Neural Network[J]. Advances in Earth Science, 2008 , 23(2) : 206 -213 . DOI: 10.11867/j.issn.1001-8166.2008.02.0206
[1] World Meteorological Organization. Guide to WMO Binary Code Forms: PART I: A Guide to the Code Form FM-94 Bufr [R].World Weather Watch Technical Report No.17,1994.
[2] World Meteorological Organization. Guide to WMO Binary Code Forms: PART II:A Guide to the Code Form FM 92-IX Ext. GRIB [R].World Weather Watch Technical Report No.17,1994.
[3] Rew R K,Davis G P. NetCDF: An interface for scientific data access. Computer Graphics and Applications [J]. IEEE,1990,10(4): 76-82.
[4] Raymond D J. A C Language-Based modular system for analyzing and displaying gridded numerical data [J]. Journal of Atmospheric and Oceanic Technology,1998,5: 501-511.
[5] Wu Guoqing,Chen Hong. A lossless compression scheme for scientific data from simulation [J]. Computer Engineering and Applications,2006,5: 172-175.[吴国清,陈虹. 一种科学数据无损压缩方法[J].计算机工程与应用,2006,5: 172-175.]
[6] Lou Jian. A new scatheless compression encoding scheme for meteorological grid data based on statistical model [J]. Advances in Earth Science,2003,18(4):637-642.[罗坚. 基于统计模型的气象数据无损压缩新方法[J] 地球科学进展,2003,18(4):637-642.]
[7] Rong Guang'ao. Processing of Computer Images [M]. Beijing: Tsinghua University Press,2000:26-28,221-223.[容观澳. 计算机图像处理[M]. 北京:清华大学出版社,2000: 26-28,221-223.]
/
〈 |
|
〉 |