Optimization Theory Overview

Optimization techniques are used to find a set of design parameters,x= {x₁,x₂,...,x_n}, that can in some way be defined as optimal. In a simple case, this process might be the minimization or maximization of some system characteristic that is dependent onx. In a more advanced formulation, the objective functionf(x), to be minimized or maximized, might be subject to constraints in one or more of these forms:

Equality constraints,G_i(x) = 0 (i= 1,...,m_e)
Inequality constraints,G_i(x) ≤ 0 (i=m_e+ 1,...,m)
Parameter bounds,x_l,x_u, wherex_l≤x≤x_u, somex_lcan be –∞, and somex_ucan be ∞

A General Problem (GP) description is stated as

\min_{x} f (x),

(1)

subject to

$\begin{array}{l} \begin{matrix} G_{i} (x) = 0 & i = 1, ..., m_{e} \\ G_{i} (x) \leq 0 & i = m_{e} + 1, ..., m \end{matrix} \\ x_{l} \leq x \leq x_{u}, \end{array}$

wherexis the vector of lengthndesign parameters,f(x) is the objective function (which returns a scalar value), and the vector functionG(x) returns a vector of lengthmcontaining the values of the equality and inequality constraints evaluated atx.

An efficient and accurate solution to this problem depends not only on the size of the problem in terms of the number of constraints and design variables, but also on characteristics of the objective function and constraints. When both the objective function and the constraints are linear functions of the design variable, the problem is known as aLinear Programming (LP) problem.Quadratic Programming (QP) concerns the minimization or maximization of a quadratic objective function that is linearly constrained. For both the LP and QP problems, reliable solution procedures are readily available. More difficult to solve is theNonlinear Programming (NP) problem in which the objective function and constraints can be nonlinear functions of the design variables. A solution of the NP problem generally requires an iterative procedure to establish a direction of search at each major iteration. This solution is usually achieved by the solution of an LP, QP, or unconstrained subproblem.

All optimization takes place in real numbers. However, unconstrained least-squares problems and equation solving can be formulated and solved using complex analytic functions. SeeComplex Numbers in Optimization Toolbox Solvers.

Optimization Theory Overview

Optimization Toolbox Documentation

金宝app

8 MATLAB Cheat Sheets for Data Science