PimCity: A Compute in Memory Substrate featuring both Row and Column Parallel Computing

Salonik Resch, Husrev Cilasun, Masoud Zabihi, Zamshed Chowdhury, Zhengyang Zhao, Jian Ping Wang, Sachin S. Sapatnekar, Ulya Karpuzcu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Processing-in-memory (PIM) substrates can perform parallel computation directly within the memory array. As a result, throughput performance and energy efficiency can reach unprecedented levels, however, there are limitations. Typical PIM architectures only support parallel computing in one dimension of the memory array: Computation is performed along either multiple rows or multiple columns (but not both). This restricts data layout and makes intra-array intermediate data transfers during computation inevitable - which require reads and writes, even for short-distance data movement. Inter-array data transfers, on the other hand, become a problem for larger scale algorithms which use more than one PIM array. Such data transfers incur large communication overheads and increase the complexity of the peripheral circuitry and interconnection network between arrays. Intermediate data transfers of any form limit scalability and efficiency. To overcome this limitation, we introduce PimCity, a new PIM substrate which can compute in both the rows and the columns of the memory array. PimCity replaces intraarray data transfer (memory) operations with lower overhead logic operations inside the memory array. Further, PimCity can perform logic operations directly across neighboring memory arrays, which in turn enables low-cost inter-array data transfers. PimCity hence represents a scalable PIM architecture suitable for both HPC and embedded IoT style applications.

Original languageEnglish (US)
Title of host publication2023 IEEE International Conference on Rebooting Computing, ICRC 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350382044
DOIs
StatePublished - 2023
Event8th IEEE International Conference on Rebooting Computing, ICRC 2023 - San Diego, United States
Duration: Dec 5 2023Dec 6 2023

Publication series

Name2023 IEEE International Conference on Rebooting Computing, ICRC 2023

Conference

Conference8th IEEE International Conference on Rebooting Computing, ICRC 2023
Country/TerritoryUnited States
CitySan Diego
Period12/5/2312/6/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Fingerprint

Dive into the research topics of 'PimCity: A Compute in Memory Substrate featuring both Row and Column Parallel Computing'. Together they form a unique fingerprint.

Cite this