31
$\begingroup$

Given $f(x) = \frac{1}{2}x^TAx + b^Tx + \alpha $

where A is an nxn symmetric matrix, b is an n-dimensional vector, and alpha a scalar. Show that

$\bigtriangledown _{x}f(x) = Ax + b$

and

$H = \bigtriangledown ^{2}_{x}f(x) = A$

Is this simply a matter of taking a derivative with respect to X, how would you attack this one?

  • 8
    The symbol is called a "nabla" or "del"; see http://en.wikipedia.org/wiki/Nabla_operator2010-09-20
  • 1
    Ok, so in this case the problem is a matter of taking the derivative with respect to x of the equation given?2010-09-20
  • 0
    @Greg: Is it $\nabla _{x}f(x)=Ax+b$ or $\nabla f(x)=Ax+b$?2010-09-20
  • 0
    The first equation you wrote with a superscript 2. I don't see how the terms reduce in this problem.2010-09-20

2 Answers 2

28

$\nabla f = (\partial f/\partial x_1, \ldots, \partial f/\partial x_n)^t$ denotes the vector of partial derivatives of $f$ and is a completely standard notation.

On the other hand, $\nabla^2 f$ seems to be used here in an unusual way, namely to denote the Hessian (the matrix of all second order partial derivatives), $(\partial^2 f/\partial x_i \partial x_j)_{i,j=1}^n$.

(The usual meaning of $\nabla^2 f$ is the Laplacian, $\partial^2 f/\partial x_1^2 + \ldots + \partial^2 f/\partial x_n^2$.)

  • 2
    Not that unusual; some optimization books use $\nabla^2$ as shorthand for the Hessian (in the sense of $\nabla$ of $\nabla f$ a.k.a. the gradient).2010-09-20
  • 0
    I am used to the following notation: a) $\nabla ^{2}f$ and $\nabla ^{2}\overrightarrow{F}$ as the laplacian of $f$ (scalar function) or $\overrightarrow{F}$ (vector field), in Physics b) $\nabla ^{2}A$ as the Hessian of the matrix $A$, in optimization.2010-09-20
  • 2
    Better notation, in my opinion: $\nabla ^{2}\cdot\overrightarrow{F}$, since here the operator $\nabla$ "is" a vector, while in $\nabla^2 f$ "is" a scalar.2010-09-20
6

$\bigtriangledown f$ finds the direction of maximal change in f.

  • 1
    While this answer is true, it is not tremendously helpful, to someone who is asking such a basic question.2016-10-17