Abstract: This study proposes a novel distributed online gradient descent algorithm incorporating a time-decaying forgetting-factor (FF) mechanism. The core innovation lies in introducing a ...

Abstract: Selecting an appropriate step size is critical in Gradient Descent algorithms used to train Neural Networks for Deep Learning tasks. A small value of the step size leads to slow convergence, ...