Robust and Efficient Optimization Using a Marquardt-Levenberg Algorithm with R Package marqLevAlg

Implementations in R of classical general-purpose algorithms for local optimization generally have two major limitations which cause difficulties in applications to complex problems: too loose convergence criteria and too long calculation time. By relying on a Marquardt-Levenberg algorithm (MLA), a Newton-like method particularly robust for solving local optimization problems, we provide with marqLevAlg package an efficient and general-purpose local optimizer which (i) prevents con vergence to saddle points by using a stringent convergence criterion based on the relative distance to minimum/maximum in addition to the stability of the parameters and of the objective function; and (ii) reduces the computation time in complex settings by allowing parallel calculations at each iteration. We demonstrate through a variety of cases from the literature that our implementation reli ably and consistently reaches the optimum (even when other optimizers fail) and also largely reduces computational time in complex settings through the example of maximum likelihood estimation of different sophisticated statistical models.

Viviane Philipps , Boris P. Hejblum , Mélanie Prague , Daniel Commenges , Cécile Proust-Lima
2021-10-19

CRAN packages used

base, optimx, minpack.lm, nlmrt, marqLevAlg, doParallel, foreach, JM, lcmm, optimParallel, optim, roptim, DEoptim, GA, rgenoud, hydroPSO

CRAN Task Views implied by cited packages

Optimization, HighPerformanceComputing, ChemPhys, Cluster, Hydrology, MachineLearning, Survival

Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

Citation

For attribution, please cite this work as

Philipps, et al., "Robust and Efficient Optimization Using a Marquardt-Levenberg Algorithm with R Package marqLevAlg", The R Journal, 2021

BibTeX citation

@article{RJ-2021-089,
  author = {Philipps, Viviane and Hejblum, Boris P. and Prague, Mélanie and Commenges, Daniel and Proust-Lima, Cécile},
  title = {Robust and Efficient Optimization Using a Marquardt-Levenberg Algorithm with R Package marqLevAlg},
  journal = {The R Journal},
  year = {2021},
  note = {https://doi.org/10.32614/RJ-2021-089},
  doi = {10.32614/RJ-2021-089},
  volume = {13},
  issue = {2},
  issn = {2073-4859},
  pages = {365-379}
}