A primal-dual augmented Lagrangian

Nonlinearly constrained optimization problems can be solved by minimizing a sequence of simpler unconstrained or linearly constrained subproblems. In this paper, we consider the formulation of subproblems in which the objective function is a generalization of the Hestenes-Powell augmented Lagrangian function. The main feature of the generalized function is that it is minimized with respect to both the primal and the dual variables simultaneously. The benefits of this approach include: (i) the ability to control the quality of the dual variables during the solution of the subproblem; (ii) the availability of improved dual estimates on early termination of the subproblem; and (iii) the ability to regularize the subproblem by imposing explicit bounds on the dual variables. We propose two primal-dual variants of conventional primal methods: a primal-dual bound constrained Lagrangian (pdBCL) method and a primal-dual ℓ1 linearly constrained Lagrangian (pdℓ1LCL) method. Finally, a new sequential quadratic programming (pdSQP) method is proposed that uses the primal-dual augmented Lagrangian as a merit function.

• Publication year

  2012

• Venue

  Computational optimization and applications

• Publication date

  Unknown publication date

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.1007/s10589-010-9339-1
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Nonlinear Programming

  2010cited by this paper
• A Second Derivative SQP Method: Global Convergence

  2010cited by this paper
• A Second Derivative SQP Method: Local Convergence and Practical Issues

  2010cited by this paper
• Flexible penalty functions for nonlinear constrained optimization

  2008influential reference
• Society for Industrial and Applied Mathematics(SIAM)

  2008cited by this paper
• Primal -dual methods for nonlinear optimization

  2007cited by this paper
• SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization.: An SQP Algorithm for Large-Scale Constrained Optimization.

  2005cited by this paper
• 2. Constrained Optimization

  2005cited by this paper
• An Algorithm for Degenerate Nonlinear Programming with Rapid Local Convergence

  2005cited by this paper
• A primal-dual trust region algorithm for nonlinear optimization

  2004cited by this paper
• CUTEr and SifDec: A constrained and unconstrained testing environment, revisited

  2003cited by this paper
• SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization

  2002cited by this paper
• Properties of the Log-Barrier Function on Degenerate Nonlinear Programs

  2002cited by this paper
• Interior Methods for Nonlinear Optimization

  2002cited by this paper
• Practical Methods of Optimization: Fletcher/Practical Methods of Optimization

  2000influential reference
• A Global Convergence Analysis of an Algorithm for Large-Scale Nonlinear Optimization Problems

  1999cited by this paper
• Stabilized Sequential Quadratic Programming

  1999cited by this paper
• Primal-Dual Interior Methods for Nonconvex Nonlinear Programming

  1998cited by this paper
• Sequential Quadratic Programming

  1995influential reference
• CUTE: constrained and unconstrained testing environment

  1995cited by this paper
• Intopt: an interior point algorithm for large scale nonlinear optimization

  1995cited by this paper
• Nonlinear Programming

  1995cited by this paper
• Newton Methods for Large-Scale Linear Equality-Constrained Minimization

  1993cited by this paper
• An SQP Augmented Lagrangian BFGS Algorithm for Constrained Optimization

  1992cited by this paper
• Interior methods for constrained optimization

  1992cited by this paper
• A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds

  1991cited by this paper
• A Convergence Theory for a Class of Quasi-Newton Methods for Constrained Optimization

  1987influential reference
• On the Accurate Determination of Search Directions for Simple Differentiable Penalty Functions

  1986influential reference
• Some theoretical properties of an augmented lagrangian merit function

  1986cited by this paper
• A family of descent functions for constrained optimization

  1984cited by this paper
• Sequential Quadratic Programming Methods with Distributed and Non-Monotone Line Search

  1983cited by this paper
• Constrained Optimization and Lagrange Multiplier Methods

  1982influential reference
• Practical Methods of Optimization. Vol. 2 — Constrained Optimization

  1982cited by this paper
• The nonlinear programming method of Wilson, Han, and Powell with an augmented Lagrangian type line search function

  1982cited by this paper
• A projected Lagrangian algorithm and its implementation for sparse nonlinear constraints

  1982influential reference
• The nonlinear programming method of Wilson, Han, and Powell with an augmented Lagrangian type line search function

  1982cited by this paper
• Practical Methods of Optimization. Vol. 1: Unconstrained Optimization

  1980cited by this paper
• A New Class of Augmented Lagrangians in Nonlinear Programming

  1979cited by this paper
• THE CONVERGENCE OF VARIABLE METRIC METHODS FOR NONLINEARLY CONSTRAINED OPTIMIZATION CALCULATIONS

  1978cited by this paper
• Exact penalty function algorithms for finite dimensional and control optimization problems

  1978cited by this paper
• A fast algorithm for nonlinearly constrained optimization calculations

  1978cited by this paper
• Diagonalized multiplier methods and quasi-Newton methods for constrained optimization

  1977influential reference
• Monotone Operators and the Proximal Point Algorithm

  1976cited by this paper
• Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming

  1976cited by this paper
• A globally convergent method for nonlinear programming

  1975cited by this paper
• A quadratically-convergent algorithm for general nonlinear programming problems

  1972cited by this paper
• A method for nonlinear constraints in minimization problems

  1969influential reference
• Multiplier and gradient methods

  1969cited by this paper
• Nonlinear Programming—Sequential Unconstrained Minimization Techniques

  1969cited by this paper
• On the relative efficiencies of gradient methods

  1967cited by this paper
• The Fritz John Necessary Optimality Conditions in the Presence of Equality and Inequality Constraints

  1967cited by this paper
• C Xxxx Society for Industrial and Applied Mathematics a Globally Convergent Linearly Constrained Lagrangian Method for Nonlinear Optimization *

  year unknowncited by this paper

• MadNCL: A GPU Implementation of Algorithm NCL for Large-Scale, Degenerate Nonlinear Programs

  2025cites this paper
• On Accretion in the Polar V379 Vir

  2025cites this paper
• Augmented Lagrangian methods for fully convex composite optimization

  2025cites this paper
• An Optimal Control Interpretation of Augmented Distributed Optimization Algorithms

  2025cites this paper
• ProxDDP: Proximal Constrained Trajectory Optimization

  2025cites this paper
• Feasibility Informed Advantage Weighted Regression for Persistent Safety in Offline Reinforcement Learning

  2025cites this paper
• Reinforcement learning for online hyperparameter tuning in convex quadratic programming

  2025cites this paper
• A Framework for Distributed Personalized Optimization in Cyber-Physical Systems via Multi-Parameter Fractional Dynamics

  2025cites this paper
• An arc-search interior-point algorithm for nonlinear constrained optimization

  2025cites this paper
• Occlusion-Aware Consistent Model Predictive Control for Robot Navigation in Occluded Obstacle-Dense Environments

  2025cites this paper
• Endpoint-Explicit Differential Dynamic Programming via Exact Resolution

  2025cites this paper
• Second-Order Constrained Dynamic Optimization

  2024cites this paper
• An Efficient Active-Set method With Applications to Sparse Approximations and Risk Minimization

  2024cites this paper
• Implicit augmented Lagrangian and generalized optimization

  2023cites this paper
• Framework for Segmented threshold <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" id="d1e4287" altimg="si398.svg"><mml:msub><mml:mrow><mml:mi>ℓ</mml:mi></mml:mrow><mml:mrow><mml:mn>0</mml:mn></mml:mrow></mml:msub></mml:math> gradient approximation based network for sparse s

  2023cites this paper
• Multi-view Subspace Clustering with Complex Noise Modeling

  2023cites this paper
• Differential Dynamic Programming based Hybrid Manipulation Strategy for Dynamic Grasping

  2023cites this paper
• COAP 2022 Best Paper Prize

  2023cites this paper
• Full Waveform Inversion and Lagrange Multipliers

  2023cites this paper
• Distributed optimal control of nonlinear systems using a second-order augmented Lagrangian method

  2023cites this paper
• Primal-dual differential dynamic programming: A model-based reinforcement learning for constrained dynamic optimization

  2022cites this paper
• ProxNLP: a primal-dual augmented Lagrangian solver for nonlinear programming in Robotics and beyond

  2022cites this paper
• An active-set method for sparse approximations. Part I: Separable $\ell_1$ terms

  2022influential citation
• On a primal-dual Newton proximal method for convex quadratic programs

  2022cites this paper
• A semismooth Newton-proximal method of multipliers for 𝓁1-regularized convex quadratic programming

  2022influential citation
• A Projected-Search Interior Method for Nonlinear Optimization

  2022cites this paper
• Constrained Structured Optimization and Augmented Lagrangian Proximal Methods

  2022cites this paper
• Implicit Differential Dynamic Programming

  2022cites this paper
• CALIPSO: A Differentiable Solver for Trajectory Optimization with Conic and Complementarity Constraints

  2022cites this paper
• PROX-QP: Yet another Quadratic Programming Solver for Robotics and beyond

  2022influential citation
• Constrained Differential Dynamic Programming: A primal-dual augmented Lagrangian approach

  2022influential citation
• A primal-dual majorization-minimization method for large-scale linear programs

  2022cites this paper
• Performance measure for sparse recovery algorithms in compressed sensing perspective

  2022cites this paper
• Constrained composite optimization and augmented Lagrangian methods

  2022cites this paper
• Multi-task multi-modality SVM for early COVID-19 Diagnosis using chest CT data

  2021cites this paper
• A novel sparse reconstruction method based on multi-objective Artificial Bee Colony algorithm

  2021cites this paper
• Nesterov Acceleration for Equality-Constrained Convex Optimization via Continuously Differentiable Penalty Functions

  2021cites this paper
• On the convergence of augmented Lagrangian strategies for nonlinear programming

  2021cites this paper
• Sufficiently Accurate Model Learning for Planning

  2021cites this paper
• A novel augmented Lagrangian method of multipliers for optimization with general inequality constraints

  2021cites this paper
• A Shifted Primal-Dual Penalty-Barrier Method for Nonlinear Optimization

  2020cites this paper
• Virtual SDNs

  2020cites this paper
• D-SOP: Distributed Second Order Proximal Method for Convex Composite Optimization

  2020cites this paper
• Constrained and Sparse Switching Times Optimization via Augmented Lagrangian Proximal Methods

  2020influential citation
• On the convergence of the classical safeguarded augmented Lagrangian method and a new primal-dual strategy ∗

  2020cites this paper
• A globally convergent primal-dual interior-point relaxation method for nonlinear programs

  2019cites this paper
• Efficient projection onto a low-dimensional ball

  2019cites this paper
• An interior point-proximal method of multipliers for convex quadratic programming

  2019cites this paper
• Deep Learning based Image Retrieval with Weight Learning and Diffusion Modelling

  2019cites this paper
• Robust SVM with adaptive graph learning

  2019influential citation
• Fast Algorithms for Acoustic Impulse Response Shaping

  2019cites this paper
• Hybrid globalization of convergence of subspace-stabilized sequential quadratic programming method

  2019cites this paper
• Fragmentary Multi-Instance Classification

  2019influential citation
• A Primal-Dual Augmented Lagrangian Penalty-Interior-Point Algorithm for Nonlinear Programming

  2018cites this paper
• A primal-dual interior-point relaxation method for nonlinear programs

  2018cites this paper
• A quasi-Newton augmented Lagrangian algorithm for constrained optimization problems

  2018influential citation
• Détection de la non-réalisabilité et stratégies de régularisation en optimisation non linéaire

  2018cites this paper
• An Augmented Lagrangian Filter Method for Real-Time Embedded Optimization

  2017cites this paper
• Introduction to Nonlinear Programming

  2017cites this paper
• A Second Order Primal-Dual Method for Nonsmooth Convex Composite Optimization

  2017influential citation
• Optimization and control of large-scale networked systems

  2017influential citation
• A stabilized SQP method: global convergence

  2017influential citation
• A second order primal-dual algorithm for nonsmooth convex composite optimization

  2017influential citation
• A globally and quadratically convergent primal–dual augmented Lagrangian algorithm for equality constrained optimization

  2017influential citation
• An efficient multi-feature SVM solver for complex event detection

  2017influential citation
• A Mixed Logarithmic Barrier-Augmented Lagrangian Method for Nonlinear Optimization

  2017cites this paper
• A primal–dual augmented Lagrangian penalty-interior-point filter line search algorithm

  2017cites this paper
• Subspace-stabilized sequential quadratic programming

  2017cites this paper
• Low Dose PET Image Reconstruction with Total Variation Using Alternating Direction Method

  2016cites this paper
• An Augmented Lagrangian Based Algorithm for Distributed NonConvex Optimization

  2016influential citation
• Globalizing Stabilized Sequential Quadratic Programming Method by Smooth Primal-Dual Exact Penalty Function

  2016cites this paper
• Semi-Supervised Weight Learning for the Spatial Search Method in ConvNet-Based Image Retrieval

  2016cites this paper
• A stabilized SQP method: superlinear convergence

  2016influential citation
• A Nonmonotone Filter SQP Method: Local Convergence and Numerical Results

  2015cites this paper
• Critical Lagrange multipliers: what we currently know about them, how they spoil our lives, and what we can do about it

  2015cites this paper
• Critical Lagrange multipliers: what we currently know about them, how they spoil our lives, and what we can do about it

  2015cites this paper
• Comments on: Critical Lagrange multipliers: what we currently know about them, how they spoil our lives, and what we can do about it

  2015cites this paper
• Primal-Dual Active-Set Methods for Convex Quadratic Optimization with Applications

  2015cites this paper
• Primal-Dual Interior Methods for Quadratic Programming

  2015influential citation
• Comments on: Critical Lagrange multipliers: what we currently know about them, how they spoil our lives, and what we can do about it

  2015cites this paper
• Augmented Lagrangian Objective Penalty Function

  2015cites this paper
• Combining stabilized SQP with the augmented Lagrangian algorithm

  2015cites this paper
• Primal-Dual Active-Set Methods for Large-Scale Optimization

  2015cites this paper
• A robust sparse approach to acoustic impulse response shaping

  2015influential citation
• O C ] 1 0 M ay 2 01 2 Direction of negative curvature for regularized SQP

  2014influential citation
• Scalable Nonlinear Programming via Exact Differentiable Penalty Functions and Trust-Region Newton Methods

  2014cites this paper
• SEQUENTIAL QUADRATIC PROGRAMMING : A SURVEY

  2014cites this paper
• GLOBALIZING STABILIZED SQP BY SMOOTH PRIMAL-DUAL EXACT PENALTY FUNCTION

  2014cites this paper
• New primal SVM solver with linear computational cost for big data classifications

  2014cites this paper
• A GLOBALLY CONVERGENT STABILIZED SQP METHOD : SUPERLINEAR CONVERGENCE

  2014influential citation
• STABILIZED SEQUENTIAL QUADRATIC PROGRAMMING: A SURVEY

  2014cites this paper
• A sparsity based approach for acoustic room impulse response shortening

  2014cites this paper
• Preprint RAL-P-2014-012 R A Nonmonotone Filter SQP Method : Local Convergence and Numerical Results

  2014cites this paper
• Global Optimization with Hybrid Evolutionary Computation

  2014cites this paper
• Méthodes primales-duales régularisées pour l'optimisation non linéaire avec contraintes

  2014influential citation
• A geometric approach to image matching and synthesis of diffeomorphic paths

  2014cites this paper
• Many-Threaded Differential Evolution on the GPU

  2013cites this paper
• A REGULARIZED SQP METHOD WITH CONVERGENCE TO SECOND-ORDER OPTIMAL POINTS

  2013cites this paper
• Semidefinite relaxations of ordering problems

  2013cites this paper
• A Globally Convergent Stabilized SQP Method

  2013influential citation