Partial Derivatives

Linear

Functions with more than one variable. e.g. where the following multivariate linear

The gradient is then the partial derivative with respect to each variable

Quadratic

e.g. where and

If is symmetric, . In the non-symmetric case,

Generalizations of gradients for dimensions given (expressed as matrices and vectors):

  1. =

So

  1. (if A is symmetric)