Location information is one of the key enablers to context-aware systems and applications for mobile devices. However, most existing location sensing techniques do not work or will be significantly slowed down without infrastructure support, which limits their applicability in several cases. In this paper, we propose a localization system that works for both indoor and outdoor environments in a completely offline manner. Our system leverages human users'perception of nearby textual signs, without using GPS, Wi-Fi, cellular, and Internet. It enables several important use cases, such as offline localization on wearable devices. Based on real data collected from Google Street View and OpenStreetMap, we examine the feasibility of our approach. The preliminary result was encouraging. Our system was able to achieve higher than 90% accuracy with only 4 iterations even when the speech recognition accuracy is 70%, requiring very small storage space, and consuming 44% less instantaneous power compared to GPS.