TY - JOUR
T1 - Load curve data cleansing and imputation via sparsity and low rank
AU - Mateos, Gonzalo
AU - Giannakis, Georgios B.
PY - 2013/12
Y1 - 2013/12
N2 - The smart grid vision is to build an intelligent power network with an unprecedented level of situational awareness and controllability over its services and infrastructure. This paper advocates statistical inference methods to robustify power monitoring tasks against the outlier effects owing to faulty readings and malicious attacks, as well as against missing data due to privacy concerns and communication errors. In this context, a novel load cleansing and imputation scheme is developed leveraging the low intrinsic-dimensionality of spatiotemporal load profiles and the sparse nature of "bad data." A robust estimator based on principal components pursuit (PCP) is adopted, which effects a twofold sparsity-promoting regularization through an ℓ1-norm of the outliers, and the nuclear norm of the nominal load profiles. Upon recasting the non-separable nuclear norm into a form amenable to decentralized optimization, a distributed (D-) PCP algorithm is developed to carry out the imputation and cleansing tasks using networked devices comprising the so-termed advanced metering infrastructure. If D-PCP converges and a qualification inequality is satisfied, the novel distributed estimator provably attains the performance of its centralized PCP counterpart, which has access to all networkwide data. Computer simulations and tests with real load curve data corroborate the convergence and effectiveness of the novel D-PCP algorithm.
AB - The smart grid vision is to build an intelligent power network with an unprecedented level of situational awareness and controllability over its services and infrastructure. This paper advocates statistical inference methods to robustify power monitoring tasks against the outlier effects owing to faulty readings and malicious attacks, as well as against missing data due to privacy concerns and communication errors. In this context, a novel load cleansing and imputation scheme is developed leveraging the low intrinsic-dimensionality of spatiotemporal load profiles and the sparse nature of "bad data." A robust estimator based on principal components pursuit (PCP) is adopted, which effects a twofold sparsity-promoting regularization through an ℓ1-norm of the outliers, and the nuclear norm of the nominal load profiles. Upon recasting the non-separable nuclear norm into a form amenable to decentralized optimization, a distributed (D-) PCP algorithm is developed to carry out the imputation and cleansing tasks using networked devices comprising the so-termed advanced metering infrastructure. If D-PCP converges and a qualification inequality is satisfied, the novel distributed estimator provably attains the performance of its centralized PCP counterpart, which has access to all networkwide data. Computer simulations and tests with real load curve data corroborate the convergence and effectiveness of the novel D-PCP algorithm.
KW - Advanced metering infrastructure
KW - Distributed algorithms
KW - Load curve cleansing and imputation
KW - Principal components pursuit
KW - Smart grid
UR - http://www.scopus.com/inward/record.url?scp=84890437868&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84890437868&partnerID=8YFLogxK
U2 - 10.1109/TSG.2013.2259853
DO - 10.1109/TSG.2013.2259853
M3 - Article
AN - SCOPUS:84890437868
SN - 1949-3053
VL - 4
SP - 2347
EP - 2355
JO - IEEE Transactions on Smart Grid
JF - IEEE Transactions on Smart Grid
IS - 4
M1 - 6599011
ER -