On the predictability of program behavior using different input data sets

Wei Chung Hsu, Howard Chen, Pen-Chung Yew, Dong Yuan Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

Smaller input data sets such as the test and the train input sets are commonly used in simulation to estimate the impact of architecture/micro-architecture features on the performance of SPEC benchmarks. They are also used for profile feedback compiler optimizations. In this paper, we examine the reliability of reduced input sets for performance simulation and profile feedback optimizations. We study the high level metrics such as IPC and procedure level profiles as well as lower level measurements such as execution paths exercised by various input sets on the SPEC2000int benchmark. Our study indicates that the test input sets are not suitable to be used for simulation because they do not have an execution profile similar to the reference input runs. The train data set is better than the test data sets at maintaining similar profiles to the reference input set. However, the observed execution paths leading to cache misses are very different between using the smaller input sets and the reference input sets. For current profile based optimizations, the differences in quality of profiles may not have a significant impact on performance, as tested on the Itanium processor with an Intel compiler. However, we believe the impact of profile quality will be greater for more aggressive profile guided optimizations, such as cache prefetching.

Original languageEnglish (US)
Title of host publicationProceedings - 6th Annual Workshop on Interaction between Compilers and Computer Architectures, INTERACT 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages45-53
Number of pages9
ISBN (Electronic)0769515347
DOIs
StatePublished - Jan 1 2002
Event6th Annual Workshop on Interaction between Compilers and Computer Architectures, INTERACT 2002 - Cambridge, United States
Duration: Feb 3 2002 → …

Publication series

NameProceedings - Annual Workshop on Interaction between Compilers and Computer Architectures, INTERACT
Volume2002-January
ISSN (Print)1550-6207

Other

Other6th Annual Workshop on Interaction between Compilers and Computer Architectures, INTERACT 2002
CountryUnited States
CityCambridge
Period2/3/02 → …

Keywords

  • Benchmark testing
  • Computer science
  • Design optimization
  • Feedback
  • Microprocessors
  • Optimizing compilers
  • Program processors
  • Runtime

Fingerprint Dive into the research topics of 'On the predictability of program behavior using different input data sets'. Together they form a unique fingerprint.

Cite this