CounterMiner: Mining Big Performance Data from Hardware Counters
Yirong Lv; Bin Sun; Qingyi Luo; Jing Wang; Zhibin Yu; Xuehai Qian
2018
会议日期2018
会议地点Fukuoka, Japan
英文摘要Modern processors typically provide a small number of hardware performance counters to capture a large number of microarchitecture events1 , These counters can easily generate a huge amount (e.g., GB or TB per day) of data, which we call big performance data in cloud computing platforms with more than thousands of servers and millions of complex workloads running in a ”24/7/365” manner. The big performance data provides a precious foundation for root cause analysis of performance bottlenecks, architecture and compiler optimization, and many more. However, it is challenging to extract value from the big performance data due to: 1) the many unperceivable errors (e.g., outliers and missing values); and 2) the difficulty of obtaining insights, e.g., relating events to performance. In this paper, we propose CounterMiner, a rigorous method- ology that enables the measurement and understanding of big performance data by using data mining and machine learning techniques. It includes three novel components: 1) using data cleaning to improve data quality by replacing outliers and filling in missing values; 2) iteratively quantifying, ranking, and pruning events based on their importance with respect to performance; 3) quantifying interaction intensity between two events by residual variance. We use sixteen benchmarks (eight from CloudSuite and eight from the Spark2 version of HiBench) to evaluate CounterMiner. The experimental results show that CounterMiner reduces the average error from 28.3% to 7.7% when multiplexing 10 events on 4 hardware counters. We also conduct a real-world case study, showing that identifying important configuration parameters of Spark programs by event importance is much faster than directly ranking the importance of these parameters.
语种英语
内容类型会议论文
源URL[http://ir.siat.ac.cn:8080/handle/172644/14156]  
专题深圳先进技术研究院_数字所
推荐引用方式
GB/T 7714
Yirong Lv,Bin Sun,Qingyi Luo,et al. CounterMiner: Mining Big Performance Data from Hardware Counters[C]. 见:. Fukuoka, Japan. 2018.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace