TY - GEN
T1 - Fast projection onto the ℓ∞,1-Mixed norm ball using steffensen root search
AU - Gustavo, Chau
AU - Wohlberg, Brendt
AU - Rodriguez, Paul
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/9/10
Y1 - 2018/9/10
N2 - Mixed norms that promote structured sparsity have broad application in signal processing and machine learning problems. In this work we present a new algorithm for computing the projection onto the ℓ∞,1 ball, which has found application in cognitive neuroscience and classification tasks. This algorithm is based on a Steffensen type root search technique, with a number of improvements over prior root search methods for the same problem. First, we theoretically derive an initial guess for the root search algorithm that helps to reduce the number of iterations to be performed. Second, we change the root search method, and through an analysis of the root search function, we construct a pruning strategy that significantly reduces the number of operations. Numerical simulations show that, compared to the state-of-the-art, our algorithm is between 4 and 5 times faster on average, and of up to 14 times faster for very sparse solutions.
AB - Mixed norms that promote structured sparsity have broad application in signal processing and machine learning problems. In this work we present a new algorithm for computing the projection onto the ℓ∞,1 ball, which has found application in cognitive neuroscience and classification tasks. This algorithm is based on a Steffensen type root search technique, with a number of improvements over prior root search methods for the same problem. First, we theoretically derive an initial guess for the root search algorithm that helps to reduce the number of iterations to be performed. Second, we change the root search method, and through an analysis of the root search function, we construct a pruning strategy that significantly reduces the number of operations. Numerical simulations show that, compared to the state-of-the-art, our algorithm is between 4 and 5 times faster on average, and of up to 14 times faster for very sparse solutions.
KW - Mixed norms
KW - Projection
KW - Regularization
KW - Root search methods
UR - http://www.scopus.com/inward/record.url?scp=85054209281&partnerID=8YFLogxK
U2 - 10.1109/ICASSP.2018.8462590
DO - 10.1109/ICASSP.2018.8462590
M3 - Conference contribution
AN - SCOPUS:85054209281
SN - 9781538646588
T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
SP - 4694
EP - 4698
BT - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018
Y2 - 15 April 2018 through 20 April 2018
ER -