Please wait a minute...
img img
高级检索
地球科学进展  2003, Vol. 18 Issue (4): 637-642    DOI: 10.11867/j.issn.1001-8166.2003.04.0637
研究论文     
基于统计模型的气象数据无损压缩新方法
罗坚1,黄峰1,张韧1,王继光2
1.中国人民解放军理工大学气象学院,江苏 南京 211101;2.国防科技大学电子科学与工程学院,湖南 长沙 410073
A NEW SCATHELESS COMPRESSION ENCODING SCHEME FOR METEOROLOGICAL GRID DATA BASED ON STATISTICAL MODEL
Luo Jian1,Huang Feng1,Zhang Ren1, Wang Jiguang2
1.Institute of Meteorology, PLA University of Sciences and Technology, Nanjing 211101,China;2.Institute of Electronic Sciences and Engineering, National University of Defense Technology, Changsha 410073, China
 全文: PDF(73 KB)  
摘要:

对当前广泛使用的气象格点数据结构进行了统计分析,通过分析常用气象要素格点资料相邻格点之间的相关性及计算要素场的符号熵和信息冗余度,认为气象格点数据中存在着明显的信息冗余,具有很高的可压缩性,且相关性越好,可压缩性越高。在此分析基础上建立了气象格点数据的二维线性预测统计模型,剔除冗余信息,并结合Huf fman编码,提出了一种气象格点数据无损压缩新方法。该方法可极大提高气象格点数据的压缩率,且能保证在有效精度内数据完全无损。最后对常用气象格点资料进行了压缩对比试验,结果表明,该方案压缩效果明显优于当前国际通用的气象数据压缩编码格式(如GRIB和netCDF码),从而能够大大提高气象以及地球科学中海量数据采集、存储和传输交换的业务应用效率。

关键词: 气象数据格点资料无损压缩预测编码Huf fman编码    
Abstract:

In this paper, the general statistical structure and characteristics of meteorology grid data were analyzed. By analyzing the correlation between neighbor grid data, calculating its relevant symbol entropy and information redundancy, it was found that there is more information redundancy in meteorology grid data, so the grid data set can be better potentially compressed. The higher the correlation is, the more the condensability is. Based on above analyses, a 2-dimensions liner predictive statistical model for meteorology grid data was established to reduce information redundancy, and by combining of Huffman encoding which is efficient information source encoding scheme, a new scatheless compression scheme was designed to deal with meteorological grid data. By using the new scheme, the compression ratio for general meteorology grid data can be effectively promoted, and the compressing and uncompressing process of data is complete scatheless within available precision. Finally, a set of contrast experiment based on the usual meteorology grid data were presented and carried out. It is proved that the compression efficiency of the new scheme is evidently superior to that of GRIB and netCDF. The new compression encoding scheme may be widely used to treat with the vast data in meteorology and other earth sciences to improve the efficiency of data collecting, storing, translating and exchanging.

Key words: Meteordogical grid data    Scatheless compression    Predictive encoding    Huffman encoding.
收稿日期: 2002-07-01 出版日期: 2003-08-01
:  P413   
通讯作者: 罗坚     E-mail: jet.luo@sina.com
作者简介: 罗坚(1965-),男,湖南省长沙人,副教授,主要从事热带天气学和气象信息处理研究.E-mail:jet.luo@sina.com
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  
张韧
罗坚
黄峰
王继光

引用本文:

罗坚,黄峰,张韧,王继光. 基于统计模型的气象数据无损压缩新方法[J]. 地球科学进展, 2003, 18(4): 637-642.

Luo Jian,Huang Feng,Zhang Ren, Wang Jiguang. A NEW SCATHELESS COMPRESSION ENCODING SCHEME FOR METEOROLOGICAL GRID DATA BASED ON STATISTICAL MODEL. Advances in Earth Science, 2003, 18(4): 637-642.

链接本文:

http://www.adearth.ac.cn/CN/10.11867/j.issn.1001-8166.2003.04.0637        http://www.adearth.ac.cn/CN/Y2003/V18/I4/637

[1] World Meteorological Organization. Guide to WMO Binary Code Forms, Part I: A Guide to the Code form FM-94 Bufr[R].World Weather Watch Technical Report No.17,1994.

[2] World Meteorological Organization. Guide to WMO Binary Code Forms, Part II: A Guide to the Code form FM 92-IX Ext Grib[R]. World Weather Watch Technical Report No.17,1994.

[3] Rew R K, Davis G P. NetCDF: An Interface for Scientific Data Access, Computer Graphics and Applications[R]. IEEE, 1990.76-82.

[4] Raymond D J. A C language-based modular system for analyzing and displaying gridded numerical data[J]. Journal of Atmospheric and Oceanic Technology,1998,5: 501-511.

[5] Hong Xiaoda. Multimedia Computer and Technology of Data Compress[M]. Beijing: China International Broadcast Press, 1999.102-104 [洪小达.多媒体计算机与数据压缩技术[M].北京:中国国际广播出版社,1999.102-104.]

[6] Rong Guan’ao. Processing of Computer Images [M]. Beijing: Tsinghua University Press,2000.26-28,221-223.[容观澳.计算机图像处理[M].北京:清华大学出版社,2000. 26-28,221-223.]

[1] 罗坚,姜勇强,戴彩悌. 提升小波变换在气象格点数据无损压缩中的应用[J]. 地球科学进展, 2012, 27(4): 460-465.
[2] 赵苏璇,罗坚,杨成荫. 基于BP神经网络的气象格点数据无损压缩方法[J]. 地球科学进展, 2008, 23(2): 206-213.