TY - JOUR
T1 - An Extragradient-Based Alternating Direction Method for Convex Minimization
AU - Lin, Tianyi
AU - Ma, Shiqian
AU - Zhang, Shuzhong
N1 - Publisher Copyright:
© 2015, SFoCM.
PY - 2017/2/1
Y1 - 2017/2/1
N2 - In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy proximal mappings. However, many problems arising from statistics, image processing and other fields have the structure that while one of the two functions has an easy proximal mapping, the other function is smoothly convex but does not have an easy proximal mapping. Therefore, the classical alternating direction methods cannot be applied. To deal with the difficulty, we propose in this paper an alternating direction method based on extragradients. Under the assumption that the smooth function has a Lipschitz continuous gradient, we prove that the proposed method returns an ϵ-optimal solution within O(1 / ϵ) iterations. We apply the proposed method to solve a new statistical model called fused logistic regression. Our numerical experiments show that the proposed method performs very well when solving the test problems. We also test the performance of the proposed method through solving the lasso problem arising from statistics and compare the result with several existing efficient solvers for this problem; the results are very encouraging.
AB - In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy proximal mappings. However, many problems arising from statistics, image processing and other fields have the structure that while one of the two functions has an easy proximal mapping, the other function is smoothly convex but does not have an easy proximal mapping. Therefore, the classical alternating direction methods cannot be applied. To deal with the difficulty, we propose in this paper an alternating direction method based on extragradients. Under the assumption that the smooth function has a Lipschitz continuous gradient, we prove that the proposed method returns an ϵ-optimal solution within O(1 / ϵ) iterations. We apply the proposed method to solve a new statistical model called fused logistic regression. Our numerical experiments show that the proposed method performs very well when solving the test problems. We also test the performance of the proposed method through solving the lasso problem arising from statistics and compare the result with several existing efficient solvers for this problem; the results are very encouraging.
KW - Alternating direction method
KW - Extragradient
KW - Fused logistic regression
KW - Iteration complexity
KW - Lasso
UR - http://www.scopus.com/inward/record.url?scp=84940502201&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84940502201&partnerID=8YFLogxK
U2 - 10.1007/s10208-015-9282-8
DO - 10.1007/s10208-015-9282-8
M3 - Article
AN - SCOPUS:84940502201
SN - 1615-3375
VL - 17
SP - 35
EP - 59
JO - Foundations of Computational Mathematics
JF - Foundations of Computational Mathematics
IS - 1
ER -