Improving dynamic binary optimization through early-exit guided code region formation

Chun Chen Hsu, Pangfeng Liu, Jan Jan Wu, Pen Chung Yew, Ding Yong Hong, Wei Chung Hsu, Chien Min Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Most dynamic binary translators (DBT) and optimizers (DBO) target binary traces, i.e. frequently executed paths, as code regions to be translated and optimized. Code region formation is the most important first step in all DBTs and DBOs. The quality of the dynamically formed code regions determines the extent and the types of optimization opportunities that can be exposed to DBTs and DBOs, and thus, determines the ultimate quality of the final optimized code. The Next-Executing-Tail (NET) trace formation method used in HP Dynamo is an early example of such techniques. Many existing trace formation schemes are variants of NET. They work very well for most binary traces, but they also suffer a major problem: the formed traces may contain a large number of early exits that could be branched out during the execution. If this happens frequently, the program execution will spend more time in the slow binary interpreter or in the unoptimized code regions than in the optimized traces in code cache. The benefit of the trace optimization is thus lost. Traces/regions with frequently taken early-exits are called delinquent traces/regions. Our empirical study shows that at least 8 of the 12 SPEC CPU2006 integer benchmarks have delinquent traces. In this paper, we propose a light-weight region formation technique called Early-Exit Guided Region Formation (EEG) to improve the quality of the formed traces/regions. It iteratively identifies and merges delinquent regions into larger code regions. We have implemented our EEG algorithm in two LLVM-based multithreaded DBTs targeting ARM and IA32 instruction set architecture (ISA), respectively. Using SPEC CPU2006 benchmark suite with reference inputs, our results show that compared to an NET-variant currently used in QEMU, a state-of-the-art retargetable DBT, EEG can achieve a significant performance improvement of up to 72% (27% on average), and to 49% (23% on average) for IA32 and ARM, respectively.

Original languageEnglish (US)
Title of host publicationVEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments
Pages23-32
Number of pages10
DOIs
StatePublished - 2013
Event9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE 2013 - Houston, TX, United States
Duration: Mar 16 2013Mar 17 2013

Publication series

NameVEE 2013 - Proceedings of the ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

Other

Other9th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments, VEE 2013
CountryUnited States
CityHouston, TX
Period3/16/133/17/13

Keywords

  • Dynamic binary translation
  • Hardware-based performance monitoring
  • Hot region formation
  • Trace-based JIT compilation
  • Virtual machine

Fingerprint Dive into the research topics of 'Improving dynamic binary optimization through early-exit guided code region formation'. Together they form a unique fingerprint.

Cite this