• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Guo, Xiao-Li (Guo, Xiao-Li.) | Chen, Bo (Chen, Bo.)

收录:

CPCI-S EI Scopus

摘要:

ETL is a key link in the construction of data warehouse. On the base of analyzing the mainstream ETL tool Datastage, the data extraction, transformation and loading, proposes a ETL framework based on data processing, and the realization method and steps are discussed in detail. The framework uses HIVE as a data processing station, improve the operating efficiency of the file; data task according to the E, T and L three parts and hierarchical partitioning, conversion of data users to better grasp the process; development data using the configuration file of the task, the development personnel free out from the heavy code, will to shift the focus of the work to the data logical task, which has greatly improved the efficiency of development personnel data processing.

关键词:

data conversion data extraction data loading Data processing ETL framework

作者机构:

  • [ 1 ] [Guo, Xiao-Li]China Univ Min & Technol Beijing, Sch Mech Elect & Informat Engn, Beijing, Peoples R China
  • [ 2 ] [Chen, Bo]Beijing Univ Technol, Sch Software Engn, Beijing, Peoples R China

通讯作者信息:

  • [Guo, Xiao-Li]China Univ Min & Technol Beijing, Sch Mech Elect & Informat Engn, Beijing, Peoples R China

查看成果更多字段

相关关键词:

来源 :

MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS

ISSN: 1022-6680

年份: 2014

卷: 1049

页码: 1966-,

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

在线人数/总访问数:1842/2912526
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司