Optimization Notes
Optimization Notes
Local minima, local maxima and saddle point- Critical points Our goal is
to now find maximum and/or minimum values of functions of several variables, e.g.,
f (x, y) over prescribed domains. As in the case of single-variable functions, we must
first establish the notion of critical points of such functions.
Solution
To find critical points, we find (x, y) that satisfy fx = 0 and fy = 0, i.e
fx = 2xy − 2y 2 + 3y = 0
fy = x2 − 4xy + 3x = 0
First of all, we note that the partial derivatives fx and fy are defined for all (x, y).
We can factorize these equations further to give
y(2x − 2y + 3) = 0
x(x − 4y + 3) = 0
The above equations must be satisfied simultaneously. There are four possibilities:
1
1. x = 0 and y = 0, implying that (0, 0) is a critical point.
Now, the question which comes is ’are this points local minimum, local maximum or
saddle point?’.
To identify each point we must use the second partial derivatives of f (x, y
2
The condition for a critical point fx = fy = 0 is satisfied only by (0, 0). The second
derivatives at (0, 0) are A = fxx (0, 0) = 2, B = fxy (0, 0) = 0, C = fyy (0, 0) = 2.
Find all the critical points of the following functions and identify them.
1. f (x, y) = x2 − 2xy
2. sin(xy)
3. y cos(2x)
4. sin(x) + cos(y)
5. x3 y + 3x − 2y
6. exy + x2 y 2
7. sin x2 y − xy
8. ln(x2 + y 2 )
9. ln(sin(xy))
x
10. cos y