SimBU: Self-Similarity-Based Hybrid Binary-Unary Computing for Nonlinear Functions

Alireza Khataei, Gaurav Singh, Kia Bazargan

Research output: Contribution to journalArticlepeer-review

Abstract

Unary computing is a relatively new method for implementing arbitrary nonlinear functions that uses unpacked, thermometer number encoding, enabling much lower hardware costs. In its original form, unary computing provides no trade-off between accuracy and hardware cost. In this work, we propose a novel self-similarity-based method to optimize the previous hybrid binary-unary work and provide it with the trade-off between accuracy and hardware cost by introducing controlled levels of approximation. Looking for self-similarity between different parts of a function allows us to implement a very small subset of core unique subfunctions and derive the rest of the subfunctions from this core using simple linear transformations. We compare our method to previous works such as FloPoCo-LUT (lookup table), HBU (hybrid binary-unary) and FloPoCo-PPA (piecewise polynomial approximation) on several 8–12-bit nonlinear functions including Log, Exp, Sigmoid, GELU, Sin, and Sqr, which are frequently used in neural networks and image processing applications. The area × delay hardware cost of our method is on average 32%–60% better than previous methods in both exact and approximate implementations. We also extend our method to multivariate nonlinear functions and show on average 78%–92% improvement over previous work.

Original languageEnglish (US)
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Computers
DOIs
StateAccepted/In press - 2024

Bibliographical note

Publisher Copyright:
IEEE

Keywords

  • activation function
  • approximate computing
  • Costs
  • Delays
  • Hardware
  • hardware acceleration
  • Image coding
  • Logic gates
  • nonlinear function
  • piecewise polynomial approximation
  • Polynomials
  • stochastic computing
  • table-based method
  • unary computing
  • Wires

Fingerprint

Dive into the research topics of 'SimBU: Self-Similarity-Based Hybrid Binary-Unary Computing for Nonlinear Functions'. Together they form a unique fingerprint.

Cite this