Quasi-Newton methods attempt to generate an estimate of the inverse of the Hessian matrix . This is then used to determine the next iteration point.
The gradient in the region around a is given by
At the minima the gradient is zero
thus the best next direction step is given by
The BFGS (`Broyden-Fletcher-Goldfarb-Shanno') algorithm is based on this technique .