arrow
Volume 26, Issue 3
On the Separable Nonlinear Least Squares Problems

Xin Liu & Yaxiang Yuan

J. Comp. Math., 26 (2008), pp. 390-403.

Published online: 2008-06

Export citation
  • Abstract

Separable nonlinear least squares problems are a special class of nonlinear least squares problems, where the objective functions are linear and nonlinear on different parts of variables. Such problems have broad applications in practice. Most existing algorithms for this kind of problems are derived from the variable projection method proposed by Golub and Pereyra, which utilizes the separability under a separate framework. However, the methods based on variable projection strategy would be invalid if there exist some constraints to the variables, as the real problems always do, even if the constraint is simply the ball constraint. We present a new algorithm which is based on a special approximation to the Hessian by noticing the fact that certain terms of the Hessian can be derived from the gradient. Our method maintains all the advantages of variable projection based methods, and moreover, it can be combined with trust region methods easily and can be applied to general constrained separable nonlinear problems. Convergence analysis of our method is presented and numerical results are also reported.

  • AMS Subject Headings

65K05, 65H10.

  • Copyright

COPYRIGHT: © Global Science Press

  • Email address
  • BibTex
  • RIS
  • TXT
@Article{JCM-26-390, author = {Xin Liu and Yaxiang Yuan}, title = {On the Separable Nonlinear Least Squares Problems}, journal = {Journal of Computational Mathematics}, year = {2008}, volume = {26}, number = {3}, pages = {390--403}, abstract = {

Separable nonlinear least squares problems are a special class of nonlinear least squares problems, where the objective functions are linear and nonlinear on different parts of variables. Such problems have broad applications in practice. Most existing algorithms for this kind of problems are derived from the variable projection method proposed by Golub and Pereyra, which utilizes the separability under a separate framework. However, the methods based on variable projection strategy would be invalid if there exist some constraints to the variables, as the real problems always do, even if the constraint is simply the ball constraint. We present a new algorithm which is based on a special approximation to the Hessian by noticing the fact that certain terms of the Hessian can be derived from the gradient. Our method maintains all the advantages of variable projection based methods, and moreover, it can be combined with trust region methods easily and can be applied to general constrained separable nonlinear problems. Convergence analysis of our method is presented and numerical results are also reported.

}, issn = {1991-7139}, doi = {https://doi.org/}, url = {http://global-sci.org/intro/article_detail/jcm/8633.html} }
TY - JOUR T1 - On the Separable Nonlinear Least Squares Problems AU - Xin Liu & Yaxiang Yuan JO - Journal of Computational Mathematics VL - 3 SP - 390 EP - 403 PY - 2008 DA - 2008/06 SN - 26 DO - http://doi.org/ UR - https://global-sci.org/intro/article_detail/jcm/8633.html KW - Separable nonlinear least squares problem, Variable projection method, Gauss-Newton method, Levenberg-Marquardt method, Trust region method, Asymptotical convergence rate, Data fitting. AB -

Separable nonlinear least squares problems are a special class of nonlinear least squares problems, where the objective functions are linear and nonlinear on different parts of variables. Such problems have broad applications in practice. Most existing algorithms for this kind of problems are derived from the variable projection method proposed by Golub and Pereyra, which utilizes the separability under a separate framework. However, the methods based on variable projection strategy would be invalid if there exist some constraints to the variables, as the real problems always do, even if the constraint is simply the ball constraint. We present a new algorithm which is based on a special approximation to the Hessian by noticing the fact that certain terms of the Hessian can be derived from the gradient. Our method maintains all the advantages of variable projection based methods, and moreover, it can be combined with trust region methods easily and can be applied to general constrained separable nonlinear problems. Convergence analysis of our method is presented and numerical results are also reported.

Xin Liu and Yaxiang Yuan. (2008). On the Separable Nonlinear Least Squares Problems. Journal of Computational Mathematics. 26 (3). 390-403. doi:
Copy to clipboard
The citation has been copied to your clipboard