논문KCI 등재
MODIFIED LIMITED MEMORY BFGS METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
주제분류수학
초록
In this paper, we propose two limited memory BFGS algorithms with a nonmonotone line search technique for unconstrained optimization problems. The global convergence of the given methods will be established under suitable conditions. Numerical results show that the presented algorithms are more competitive than the normal BFGS method.
Abstract
In this paper, we propose two limited memory BFGS algorithms with a nonmonotone line search technique for unconstrained optimization problems. The global convergence of the given methods will be established under suitable conditions. Numerical results show that the presented algorithms are more competitive than the normal BFGS method.
참고문헌 (51)
- C. G. Broyden, "On the local and superlinear convergence of quasi-Newton methods", J. Inst. Math. Appl., 12, pp.223~245 (1973)
- R. H. Byrd, "A tool for the analysis of quasi-Newton methods with application to unconstrained minimization", SIAM J. Numer. Anal., 26(3), pp.727~739 (1989)
- R. H. Byrd, "Representations of quasi-Newton matrices and their use in limited memory methods", Math. Programming, 63(2), pp.129~156 (1994)
- R. Byrd, "Global convergence of a class of quasi-Newton methods on convex problems", SIAM J. Numer. Anal., 24(5), pp.1171~1190 (1987)
- Y. Dai, "Convergence properties of the BFGS algorithm", SIAM J. Optim., 13(3), pp.693~701 (2002)
- Y. Dai, "Testing different conjugate gradient methods for large-scale unconstrained optimization", J. Comput. Math., 21(3), pp.311~320 (2003)
- Variable metric methods for minimization, "W. C. Davidon", ~, pp.A. E. C. Research and Development Report ANL-599 (1959)
- R. Dembo, "Truncated Newton algorithms for large-scale unconstrained optimization", Math. Programming, 26(2), pp.190~212 (1983)
- J. E. Dennis Jr., "Quasi-Newton methods, motivation and theory", SIAM Rev., 19(1), pp.46~89 (1977)
- J. E. Dennis Jr., "A characterization of superlinear convergence and its application to quasi-Newton methods", Math. Comp., 28, pp.549~560 (1974)
- J. E. Dennis Jr., "Numerical Methods for Unconstrained Optimization and Nonlinear Equations" (1983), Prentice Hall, Inc.
- L. C. W. Dixon, "Variable metric algorithms: necessary and sufficient conditions for identical behavior of nonquadratic functions", J. Optimization Theory Appl., 10, pp.34~40 (1972)
- E. D. Dolan, "Benchmarking optimization software with performance profiles", Math. Program. Ser. A, 91(2), pp.201~213 (2002)
- R. Fletcher, "Practical Methods of Optimization, Second edition" (1987), A Wiley-Interscience Publication. John Wiley & Sons, Ltd.
- N. I. M. Gould, "CUTEr (and SifDec), a constrained and unconstrained testing environment, revisite", ACM Transactions on Mathematical Software, 29, pp.373~394 (2003)
- A. Griewank, "The global convergence of partitioned BFGS on problems with convex decompositions and Lipschitzian gradients", Math. Programming(Ser. A), 50(2), pp.141~175 (1991)
- A. Griewank, "Local convergence analysis for partitioned quasi-Newton updates", Numer. Math., 39(3), pp.429~448 (1982)
- L. Grippo, "A nonmonotone line search technique for Newton’s method", SIAM J. Numer. Anal., 23(4), pp.707~716 (1986)
- L. Grippo, "A truncated Newton method with nonmonotone line search for unconstrained optimization", J. Optim. Theory Appl., 60(3), pp.401~419 (1989)
- L. Grippo, "A class of nonmonotone stabilization methods in unconstrained optimization", Numer. Math., 59(8), pp.779~805 (1991)
- J. Y. Han, "Global convergence analysis of a new nonmonotone BFGS algorithm on convex objective functions", Comput. Optim. Appl., 7(3), pp.277~289 (1997)
- D. Li, "A modified BFGS method and its global convergence in nonconvex minimization", J. Comput. Appl. Math., 129(1), pp.15~35 (2001)
- D. Li, "On the global convergence of the BFGS method for nonconvex unconstrained optimization problems", SIAM J. Optim., 11(4), pp.1054~1064 (2001)
- G. Li, "New conjugacy condition and related new conjugate gradient methods for unconstrained optimization", J. Comput. Appl. Math., 202(2), pp.523~539 (2007)
- G. H. Liu, "Notes on the general form of stepsize selection", OR and Decision Making, 1, pp.619~624 (1992)
- Global convergence Analysis of the variable metric algorithm with a generalized Wolf linesearch, Technical Report, "G. H. Liu", Institute of Applied Mathematics, ~, pp.Academia Sinica, Beijing, China, no. 029 (1993)
- G. H. Liu, "Global convergence of the BFGS algorithm with nonmonotone linesearch", Optimization, 34(2), pp.147~159 (1995)
- G. H. Liu, "The convergence properties of a nonmonotonic algorithm", J. Comput. Math., 1, pp.65~71 (1992)
- W. F. Mascarenhas, "The BFGS method with exact line searches fails for non-convex objective functions", Math. Program. Ser. A, 99(1), pp.49~61 (2004)
- J. J. Mor´e, "Testing unconstrained optimization software", ACM Trans. Math. Software, 7(1), pp.17~41 (1981)
- S. G. Nash, "A survey of truncated-Newton methods, Numerical analysis 2000, Vol. IV, Optimization and nonlinear equations", J. Comput. Appl. Math., 124(1), pp.45~59 (2000)
- M. J. D. Powell, "On the convergence of the variable metric algorithm", J. Inst. Math. Appl., 7, pp.21~36 (1971)
- M. J. D. Powell, "Some global convergence properties of a variable metric algorithm for minimization without exact line searches, Nonlinear programming", SIAM-AMS Proc., 통권 : 11, pp.53~72 (1976), Amer. Math. Soc.
- M. J. D. Powell, "A new algorithm for unconstrained optimization, 1970 Nonlinear Programming", Proc. Sympos., pp.31~65 (1970), Academic Press
- M. Raydan, "The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem", SIAM J. Optim., 7(1), pp.26~33 (1997)
- J. Schropp, "A note on minimization problems and multistep methods", Numer. Math., 78(1), pp.87~101 (1997)
- J. Schropp, "One-step and multistep procedures for constrained minimization problems", IMA J. Numer. Anal., 20(1), pp.135~152 (2000)
- Ph. L. Toint, "Global convergence of the partitioned BFGS algorithm for convex partially separable optimization", Math. Programming, 36(3), pp.290~306 (1986)
- D. J. van Wyk, "Differential optimization techniques", Appl. Math. Modelling, 8(6), pp.419~424 (1984)
- M. N. Vrahatis, "A class of gradient unconstrained minimization algorithms with adaptive stepsize", J. Comput. Appl. Math., 114(2), pp.367~386 (2000)
- Z. Wei, "New quasi-Newton methods for unconstrained optimization problems", Appl. Math. Comput., 175(2), pp.1156~1188 (2006)
- Z. Wei, "The superlinear convergence of a modified BFGStype method for unconstrained optimization", Comput. Optim. Appl., 29(3), pp.315~332 (2004)
- G. L. Yuan, "Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems", Optim. Lett., 3(1), pp.11~21 (2009)
- G. L. Yuan, "A new line search method with trust region for unconstrained optimization", Comm. Appl. Nonlinear Anal., 15(1), pp.35~49 (2008)
- G. L. Yuan, "A modified PRP conjugate gradient method", Ann. Oper. Res., 166, pp.73~90 (2009)
- G. L. Yuan, "A conjugate gradient method with descent direction for unconstrained optimization", J. Comput. Appl. Math., 233(2), pp.519~530 (2009)
- Y. Yuan, "Theory and Methods of Optimization" (1999), Science Press of China
- Gonglin Yuan, "New line search methods for unconstrained optimization", Journal of the Korean Statistical Society, 38(1), pp.29~39 (2009), 한국통계학회
- G. L. Yuan, "The superlinear convergence analysis of a nonmonotone BFGS algorithm on convex objective functions", Acta Math. Sin. (Engl. Ser.), 24(1), pp.35~42 (2008)
- G. L. Yuan, "Convergence analysis of a modified BFGS method on convex minimizations", Comput. Optim. Appl.
- J. Z. Zhang, "New quasi-Newton equation and related methods for unconstrained optimization", J. Optim. Theory Appl., 102(1), pp.147~167 (1999)
관련 논문AI추천
A general family of modified BFGS methods for unconstrained optimization윤상운, 정도희, 정윤모, 천창범대한수학회 · 대한수학회지2025 · 제62권 제4호A CLASS OF NONMONOTONE SPECTRAL MEMORY GRADIENT METHODJingzhao Liu, Jinsong Zang, Zhensheng Yu대한수학회 · 대한수학회지2010 · 제47권 제1호Global convergence of an efficient hybrid conjugate gradient method for unconstrained optimizationJinkui Liu, Xianglin Du대한수학회 · 대한수학회보2013 · 제50권 제1호A new quasi-Newton method based on adjoint Broyden updates for symmetric nonlinear equationsHuiping Cao대한수학회 · 대한수학회지2016 · 제53권 제6호A NOVEL FILLED FUNCTION METHOD FOR GLOBAL OPTIMIZATIONLiansheng Zhang, Yongjian Yang, Youjiang Lin대한수학회 · 대한수학회지2010 · 제47권 제6호An active set SQP-filter method for solving nonlinear programmingHui An, Ke Su, Yingna Yuan영남수학회 · East Asian Mathematical Journal2012 · 제28권 제3호
이 간행물의 다른 논문 (13건)
OSCILLATORY BEHAVIOR OF A CERTAIN CLASS OF SECOND-ORDER NONLINEAR PERTURBED DYNAMIC EQUATIONS ON TIME SCALESSamir H. Sakerpp. 659-674ON THE TOPOLOGY OF DIFFEOMORPHISMS OF SYMPLECTIC 4-MANIFOLDS김진홍pp. 675-689GORENSTEIN-INJECTORS, GORENSTEIN-FLATORSWenping Zhou, Qinqin Gu, Xiaosheng Zhupp. 691-704LIE BIALGEBRAS ARISING FROM POISSON BIALGEBRAS조은희, 오세권pp. 705-718A STRUCTURE ON COEFFICIENTS OF NILPOTENT POLYNOMIALS류성주, 이양, 전영철pp. 719-733
