• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Tao, Dingwen (Tao, Dingwen.) | Di, Sheng (Di, Sheng.) | Chen, Zizhong (Chen, Zizhong.) | Cappello, Franck (Cappello, Franck.)

收录:

EI Scopus

摘要:

In situ lossy compression allowing user-controlled data loss can significantly reduce the I/O burden. For large-scale N-body simulations where only one snapshot can be compressed at a time, the lossy compression ratio is very limited because of the fairly low spatial coherence of the particle data. In this work, we assess the state-of-the-art single-snapshot lossy compression techniques of two common N-body simulation models: cosmology and molecular dynamics. We design a series of novel optimization techniques based on the two representative real-world N-body simulation codes. For molecular dynamics simulation, we propose three compression modes (i.e., best speed, best tradeoff, best compression mode) that can refine the tradeoff between the compression rate (a.k.a., speed/throughput) and ratio. For cosmology simulation, we identify that our improved SZ is the best lossy compressor with respect to both compression ratio and rate. Its compression ratio is higher than the second-best compressor by 11% with comparable compression rate. Experiments with up to 1024 cores on the Blues supercomputer at Argonne show that our proposed lossy compression method can reduce I/O time by 80% compared with writing data directly to a parallel file system and outperforms the second-best solution by 60%. Moreover, our proposed lossy compression methods have the best rate-distortion with reasonable compression errors on the tested N-body simulation data compared with state-of-the-art compressors. © 2017 IEEE.

关键词:

Big data Compressors Cosmology Data compression ratio Electric distortion File organization Molecular dynamics Signal distortion Supercomputers

作者机构:

  • [ 1 ] [Tao, Dingwen]University of California, Riverside; CA, United States
  • [ 2 ] [Di, Sheng]Argonne National Laboratory, IL, United States
  • [ 3 ] [Chen, Zizhong]University of California, Riverside; CA, United States
  • [ 4 ] [Chen, Zizhong]Beijing University of Technology, Beijing, China
  • [ 5 ] [Cappello, Franck]Argonne National Laboratory, IL, United States
  • [ 6 ] [Cappello, Franck]University of Illinois at Urbana-Champaign, IL, United States

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

年份: 2017

卷: 2018-January

页码: 486-493

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次: 23

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

归属院系:

在线人数/总访问数:258/2899654
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司