Abstract
In this paper, we address the challenge of recovering a time sequence of counts from aggregated historical data. For example, given a mixture of the monthly and weekly sums, how can we find the daily counts of people infected with flu? In general, what is the best way to recover historical counts from aggregated, possibly overlapping historical reports, in the presence of missing values? Equally importantly, how much should we trust this reconstruction? We propose H-FUSE, a novel method that solves above problems by allowing injection of domain knowledge in a principled way, and turning the task into a welldefined optimization problem. H-FUSE has the following desirable properties: (a) Effectiveness, recovering historical data from aggregated reports with high accuracy; (b) Self-awareness, providing an assessment of when the recovery is not reliable; (c) Scalability, computationally linear on the size of the input data. Experiments on the real data (epidemiology counts from the Tycho project [13]) demonstrates that H-FUSE reconstructs the original data 30 - 81% better than the least squares method.
Original language | English (US) |
---|---|
Title of host publication | Proceedings of the 17th SIAM International Conference on Data Mining, SDM 2017 |
Editors | Nitesh Chawla, Wei Wang |
Publisher | Society for Industrial and Applied Mathematics Publications |
Pages | 786-794 |
Number of pages | 9 |
ISBN (Electronic) | 9781611974874 |
DOIs | |
State | Published - 2017 |
Event | 17th SIAM International Conference on Data Mining, SDM 2017 - Houston, United States Duration: Apr 27 2017 → Apr 29 2017 |
Publication series
Name | Proceedings of the 17th SIAM International Conference on Data Mining, SDM 2017 |
---|
Other
Other | 17th SIAM International Conference on Data Mining, SDM 2017 |
---|---|
Country/Territory | United States |
City | Houston |
Period | 4/27/17 → 4/29/17 |
Bibliographical note
Publisher Copyright:Copyright © by SIAM.