We use different optimizers in everyday Machine Learning and Deep Learning applications. The task for any machine learning algorithm is to 𝑚𝑖𝑛 𝑓 (𝑥), where 𝑓 is the objective function and 𝑥 is the input parameter. ...