Semi-supervised Classification using Attention-based Regularization on Coarse-resolution Data

Guruprasad Nayak, Rahul Ghosh, Xiaowei Jia, Varun Mithal, Vipin Kumar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many real-world phenomena are observed at multiple resolutions. Predictive models designed to predict these phenomena typically consider different resolutions separately. This approach might be limiting in applications where predictions are desired at fine resolutions but available training data is scarce. In this paper, we propose classification algorithms that leverage supervision from coarser resolutions to help train models on finer resolutions. The different resolutions are modeled as different views of the data in a multi-view framework that exploits the complementarity of features across different views to improve models on both views. Unlike traditional multi-view learning problems, the key challenge in our case is that there is no one-to-one correspondence between instances across different views in our case, which requires explicit modeling of the correspondence of instances across resolutions. We propose to use the features of instances at different resolutions to learn the correspondence between instances across resolutions using attention mechanism.Experiments on the real-world application of mapping urban areas using satellite observations and sentiment classification on text data show the effectiveness of the proposed methods.

Original languageEnglish (US)
Title of host publicationProceedings of the 2020 SIAM International Conference on Data Mining, SDM 2020
EditorsCarlotta Demeniconi, Nitesh Chawla
PublisherSociety for Industrial and Applied Mathematics Publications
Pages253-261
Number of pages9
ISBN (Electronic)9781611976236
DOIs
StatePublished - 2020
Event2020 SIAM International Conference on Data Mining, SDM 2020 - Cincinnati, United States
Duration: May 7 2020May 9 2020

Publication series

NameProceedings of the 2020 SIAM International Conference on Data Mining, SDM 2020

Conference

Conference2020 SIAM International Conference on Data Mining, SDM 2020
CountryUnited States
CityCincinnati
Period5/7/205/9/20

Bibliographical note

Funding Information:
This research was supported by National Science Foundation under the grant IIS-1838159. Access to computing facilities was provided by the University of Minnesota Supercomputing Institute.

Fingerprint Dive into the research topics of 'Semi-supervised Classification using Attention-based Regularization on Coarse-resolution Data'. Together they form a unique fingerprint.

Cite this