Simplified Gradient Descent Optimization

Demonstration of the gradient descent optimization algorithm with a fixed step size.

This example was developed for use in teaching optimization in graduate engineering courses. This example demonstrates how the gradient descent method can be used to solve a simple unconstrained optimization problem. Taking large step sizes can lead to algorithm instability, but small step sizes result in low computational efficiency. A corresponding video can be found here:

https://youtu.be/qLpOWteWmjs