Evaluating the efficacy of statistical simulation for design space exploration

Ajay Joshi, Joshua J. Yi, Robert H. Bell, Lieven Eeckhout, Lizy John, David Lilja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Recent research has proposed statistical simulation as a technique for fast performance evaluation of superscalar microprocessors. The idea in statistical simulation is to measure a program's key performance characteristics, generate a synthetic trace with these characteristics, and simulate the synthetic trace. Due to the probabilistic nature of statistical simulation the performance estimate quickly converges to a solution, making it an attractive technique to efficiently cull a large microprocessor design space. In this paper, we evaluate the efficacy of statistical simulation in exploring the design space. Specifically, we characterize the following aspects of statistical simulation: (i) fidelity of performance bottlenecks, with respect to cycleaccurate simulation of the program, (ii) ability to track design changes, and (iii) trade-off between accuracy and complexity in statistical simulation models. In our characterization experiments, we use the Plackett & Burman (P&B) design to systematically stress statistical simulation by creating different performance bottlenecks. The key results from this paper are: (1) Synthetic traces stress at least the same 10 most significant processor performance bottlenecks as the original workload, (2) Statistical simulation can effectively track design changes to identify feasible design points in a large design space of aggressive microarchitectures, (3) Our evaluation of 4 statistical simulation models shows that although a very detailed model is needed to achieve a good absolute accuracy in performance estimation, a simple model is sufficient to achieve good relative accuracy, and (4) The P&B design technique can be used to quickly identify areas to focus on to improve the accuracy of the statistical simulation model.

Original languageEnglish (US)
Title of host publicationISPASS 2006
Subtitle of host publicationIEEE International Symposium on Performance Analysis of Systems and Software, 2006
Pages70-79
Number of pages10
StatePublished - Nov 14 2006
EventISPASS 2006: IEEE International Symposium on Performance Analysis of Systems and Software, 2006 - Austin, TX, United States
Duration: Mar 19 2006Mar 21 2006

Publication series

NameISPASS 2006: IEEE International Symposium on Performance Analysis of Systems and Software, 2006
Volume2006

Other

OtherISPASS 2006: IEEE International Symposium on Performance Analysis of Systems and Software, 2006
CountryUnited States
CityAustin, TX
Period3/19/063/21/06

Fingerprint Dive into the research topics of 'Evaluating the efficacy of statistical simulation for design space exploration'. Together they form a unique fingerprint.

Cite this