Indexed by:
Abstract:
The existing coarse-grained monitoring mechanism in Spark has much difficulty in analyzing and locating the bottleneck during the execution of tasks. Aiming to solve this problem, we divide the execution process of Spark tasks into several subphases, and propose a fine-grained subphases-based monitoring mechanism. The fine-grained monitoring mechanism can help users to understand the detail execution status of Spark tasks and be beneficial to analyze and locate the performance bottleneck in Spark.
Keyword:
Reprint Author's Address:
Email:
Source :
PROCEEDINGS OF THE ADVANCES IN MATERIALS, MACHINERY, ELECTRICAL ENGINEERING (AMMEE 2017)
ISSN: 2352-5401
Year: 2017
Volume: 114
Page: 395-399
Language: English
Cited Count:
WoS CC Cited Count: 0
SCOPUS Cited Count:
ESI Highly Cited Papers on the List: 0 Unfold All
WanFang Cited Count:
Chinese Cited Count:
30 Days PV: 4
Affiliated Colleges: