Abstract
Graphics Processing Units (GPUs) provide an attractive option for extracting data-level parallelism from diverse applications. However, some applications, although possess abundant data-level parallelism, exhibit irregular memory access patterns to the shared data structures. Porting such applications to GPUs requires synchronization mechanisms such as locks, which significantly increase the programming complexity. Coarse-grained locking, where a single lock controls all the shared resources, although reduces programming efforts, can substantially serialize GPU threads. On the other hand, fine-grained locking, where each data element is protected by an independent lock, although facilitates maximum parallelism, requires significant programming efforts. To overcome these challenges, we propose to support software transactional memory (STM) on GPU that is able to achieve performance comparable to fine-grained locking, while requiring minimal programming efforts. Software-based transactional execution can incur significant runtime overheads due to activities such as detecting conflicts across thousands of GPU threads and managing a consistent memory state. Thus, in this paper we illustrate three lightweight STM designs that are capable of scaling to a large number of GPU threads. In our system, programmers simply mark the critical sections in the applications, and the underlying STM support is able to achieve performance comparable to fine-grained locking.
Original language | English (US) |
---|---|
Article number | 6957255 |
Pages (from-to) | 461-470 |
Number of pages | 10 |
Journal | Proceedings of the International Conference on Parallel Processing |
Volume | 2014-November |
Issue number | November |
DOIs | |
State | Published - Nov 13 2014 |
Event | 43rd International Conference on Parallel Processing, ICPP 2014 - Minneapolis, United States Duration: Sep 9 2014 → Sep 12 2014 |
Bibliographical note
Publisher Copyright:© 2014 IEEE.
Keywords
- GPUs
- Parallel programming
- Software transactional memory