Taghreed: A system for querying, analyzing, and visualizing geotagged microblogs

Amr Magdy, Louai Alarabi, Saif Al-Harthi, Mashaal Musleh, Thanaa M. Ghanem, Sohaib Ghani, Mohamed F. Mokbel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

43 Scopus citations

Abstract

This paper presents Taghreed; a full-fledged system for efficient and scalable querying, analyzing, and visualizing geo- tagged microblogs, e.g., tweets. Taghreed supports arbitrary queries on a large number (Billions) of microblogs that go up to several months in the past. Taghreed consists of four main components: (1) Indexer, (2) query engine, (3) recovery manager, and (4) visualizer. Taghreed indexer efficiently digests incoming microblogs with high arrival rates in light memory-resident indexes. When the memory be- comes full, a flushing policy manager transfers the mem- ory contents to disk indexes which are managing Billions of microblogs for several months. On memory failure, the recovery manager restores the system status from replicated copies for the main-memory content. Taghreed query engine consists of two modules: a query optimizer and a query processor. The query optimizer generates an optimal query plan to be executed by the query processor through efficient retrieval techniques to provide low query response, i.e., order of milliseconds. Taghreed visualizer allows end users to issue a wide variety of spatiotemporal queries. Then, it graphically presents the answers and allows interactive exploration through them. Taghreed is the first system that addresses all these challenges collectively for microblogs data. In the paper, each system component is described in detail.

Original languageEnglish (US)
Title of host publication22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014
EditorsMarkus Schneider, Michael Gertz, Yan Huang, Jagan Sankaranarayanan, John Krumm
PublisherAssociation for Computing Machinery
Pages163-172
Number of pages10
ISBN (Electronic)9781450331319
DOIs
StatePublished - Nov 4 2014
Event22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014 - Dallas, United States
Duration: Nov 4 2014Nov 7 2014

Publication series

NameGIS: Proceedings of the ACM International Symposium on Advances in Geographic Information Systems
Volume04-07-November-2014

Other

Other22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014
CountryUnited States
CityDallas
Period11/4/1411/7/14

Keywords

  • Indexing
  • Microblogs
  • Query Processing
  • Spatio-temporal

Fingerprint Dive into the research topics of 'Taghreed: A system for querying, analyzing, and visualizing geotagged microblogs'. Together they form a unique fingerprint.

Cite this