Optimization method that iteratively updates parameters in the direction of negative gradient.