Gradient

See image gradient for the term used in graphics.

In the above two images, the scalar field is in black and white, black representing higher values, and its corresponding gradient is represented by blue arrows.

Gradient is commonly used to describe the measure of the slope (also called steepness, fall or incline) of a straight line. In the UK it is the usual term for the inclination of a surface along a given direction, which is usually called the grade in the US. Given a surface, the grade (inclination) of the surface in a particular direction given a unit vector is the dot product of the vector gradient with that vector.

A generalization of these concepts is the gradient in vector calculus; and this article will be mostly about this vector gradient. The gradient of a scalar field is a vector field which points in the direction of the greatest rate of increase of the scalar field, and whose magnitude is the greatest rate of change.
A generalization of the gradient, for functions which have vectorial values, is the Jacobian.

Interpretations of the gradient

Consider a room in which the temperature is given by a scalar field $\phi$, so at each point $(x,y,z)$ the temperature is $\phi (x,y,z)$. We will assume that the temperature does not change in time. Then, at each point in the room, the gradient at that point will show the direction in which it gets hot most quickly. The magnitude of the gradient will tell how fast it gets hot in that direction.

Consider a hill whose height at a point $(x,y)$ is $H(x,y)$. The gradient of $H$ at a point is in the direction of the steepest slope/grade at that point. The magnitude of the gradient tells how steep the slope actually is.

The gradient can also be used to tell how things change in other directions rather than the direction of largest change. Consider again the example with the hill. One can have a road which goes right uphill where the slope is largest and then its slope is the magnitude of the gradient. Or one can have a road which goes under an angle with the uphill direction, say for example an angle of 60° when projected onto the horizontal plane. Then, if the steepest slope on the hill is 40%, the road will make a shallower slope of 20% which is 40% times the cosine of 60°.

This observation can be mathematically stated as follows. The gradient of the hill height function $H$ dotted with a unit vector gives the slope of the surface in the direction of the vector. This is called the directional derivative.

Formal definition

The gradient of a scalar function $f(x)$ with respect to a vector variable $x=(x_{1},\dots ,x_{n})$ is denoted by $\nabla f$ where $\nabla$ (nabla) denotes the vector differential operator del. These other symbols are equivalent and carry the same meaning: $\nabla _{x}f(x)$, $grad(f)$.

By definition, the gradient is a column vector whose components are the partial derivatives of $f$. That is:

$\nabla f=\left({\frac {\partial f}{\partial x_{1}}},\dots ,{\frac {\partial f}{\partial x_{n}}}\right)$

Although expressed in terms of coordinates, the result is invariant under orthogonal transformations, as it should, in view of the geometric definition.

Example

In 3 dimensions, the expression expands to $\nabla f={\begin{pmatrix}{\frac {\partial f}{\partial x}},{\frac {\partial f}{\partial y}},{\frac {\partial f}{\partial z}}\end{pmatrix}}$ in Cartesian coordinates. For example, the gradient of the function

$f(x,y,z)=2x+3y^{2}-\sin(z)$

is:

$\nabla f={\begin{pmatrix}{\frac {\partial f}{\partial x}},{\frac {\partial f}{\partial y}},{\frac {\partial f}{\partial z}}\end{pmatrix}}={\begin{pmatrix}{2},{6y},{-\cos(z)}\end{pmatrix}}.$

Linear approximation to a function

The gradient of a function $f$ from the Euclidean space Rⁿ to R charaterizes the best linear approximation to that function at any particular point $x_{0}$ in Rⁿ. The approximation is as follows:

$g(x)=f(x_{0})+(\nabla _{x}f(x_{0}))^{T}(x-x_{0})$

where $\nabla _{x}f(x_{0})$ is the gradient computed at $x_{0}$.

The gradient on manifolds

For any differentiable function f on a Riemannian manifold M, the gradient of f is the vector field such that for any vector $\xi$,

$\langle \nabla f(x),\xi \rangle :=\xi f$

where $\langle \cdot ,\cdot \rangle$ denotes the inner product on M (the metric) and $\xi f$ is the function that takes any point p to the directional derivative of $f$ in the direction $\xi$ evaluated at p. In other words, under some coordinate chart$\varphi$, $\xi f(p)$ will be:

$\sum \xi _{x_{j}}(\partial _{j}f\mid _{p}):=\sum \xi _{x_{j}}({\frac {\partial }{\partial x_{j}}}(f\circ \varphi ^{-1})\mid _{\varphi (p)}).$

The gradient of a function is related to the exterior derivative, since $\xi f(p)=df(\xi )$. Indeed, the metric allows one to associate canonically the 1-form df to the vector field $\nabla f$. In Rⁿ the flat metric is implicit and the gradient can be identified with the exterior derivative.

See also

• Nabla
• Divergence
• Curl
• Sobel
• Ion gradient
• Gradient descent
• Level set
• Musical isomorphism