A Cluster Elastic Net for Multivariate Regression
View/ Open
Issue Date
2018-07-01Author
Price, Bradley S.
Sherwood, Ben
Publisher
Journal of Machine Learning Research
Type
Article
Article Version
Scholarly/refereed, publisher version
Published Version
http://jmlr.org/papers/v18/17-445.htmlRights
Copyright 2018 Bradley S. Price and Ben Sherwood. License: CC-BY 4.0, seehttps://creativecommons.org/licenses/by/4.0/. Attribution requirements are providedathttp://jmlr.org/papers/v18/17-445.html.
Metadata
Show full item recordAbstract
We propose a method for simultaneously estimating regression coefficients and clustering response variables in a multivariate regression model, to increase prediction accuracy and give insights into the relationship between response variables. The estimates of the regression coefficients and clusters are found by using a penalized likelihood estimator, which includes a cluster fusion penalty, to shrink the difference in fitted values from responses in the same cluster, and an L1 penalty for simultaneous variable selection and estimation. We propose a two-step algorithm, that iterates between k-means clustering and solving the penalized likelihood function assuming the clusters are known, which has desirable parallel computational properties obtained by using the cluster fusion penalty. If the response variable clusters are known a priori then the algorithm reduces to just solving the penalized likelihood problem. Theoretical results are presented for the penalized least squares case, including asymptotic results allowing for p≫n. We extend our method to the setting where the responses are binomial variables. We propose a coordinate descent algorithm for the normal likelihood and a proximal gradient descent algorithm for the binomial likelihood, which can easily be extended to other generalized linear model (GLM) settings. Simulations and data examples from business operations and genomics are presented to show the merits of both the least squares and binomial methods.
Collections
Citation
Price, B. S. and Sherwood, B. (2018) A Cluster Elastic Net for Multivariate Regression . Journal of Machine Learning Research, 18, 1-39.
Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.