Steepest descent method for unconstrained optimization
Article Sidebar
-
Armijo's rule, Barzilai-Borwein method, Conjugate gradient methods, Nonmonotone linesearch, Unconstrianed optimization.
Abstract
The gradient method is the basis for many nonlinear optimization methods, and is also one of the methods used to solve the large scale unconstrained optimization. It requires a small storage volume compared to its counterparts. In this paper we have given a detailed presentation of the gradient method with Armijo's rule, and then a methods to improve its performance. This is represented in the Barzilai-Borwein method, which provides us with the step length the long of the steepest descent direction without the need for linesearch, but, the Barzilai-Borwein method is not always convergent. To solve this problem, we presented an algorithm attributed to the researcher Marcos Raydan, which linked the Barzilai-Borwein method with the nonmonotone linesearch of Grippo-Lampariello-Lucidi. In the end, we conducted numerical tests of the previous methods through a Matlab computer program.
Full text article
Authors
This work is licensed under a Creative Commons Attribution 4.0 International License.
In a brief statement, the rights relate to the publication and distribution of research published in the journal of the University of Sebha where authors who have published their articles in the journal of the university of Sebha should how they can use or distribute their articles. They reserve all their rights to the published works, such as (but not limited to) the following rights:
- Copyright and other property rights related to the article, such as patent rights.
- Research published in the journal of the University of Sebha and used in its future works, including lectures and books, the right to reproduce articles for their own purposes, and the right to self-archive their articles.
- The right to enter a separate article, or for a non-exclusive distribution of their article with an acknowledgment of its initial publication in the journal of Sebha University.
Privacy Statement The names and e-mail addresses entered on the Sabha University Journal site will be used for the aforementioned purposes only and for which they were used.