grad_descent.zip

Gradient Descent (Batch) Algorithm for OLS

This is the simple implementation of batch gradient descent algorithm for OLS. At the end of the file we use standard OLS in matrix form to check if gradient descent algorithm provided sensible results.
If the algorithm does not converge and gradient descent values are 'too far' from ordinary OLS values, change learning rate, initial guess or other things within the algorithm.