Event(s) on June 2022

• Friday, 17th June, 2022

  Title:	Statistical Learning Theory of Stochastic Gradient Methods
  Speaker:	Dr. Yunwen Lei , Computer Science, University of Birmingham, UK
  Time/Place:	15:00  -  16:00 Zoom, (Meeting ID: 926 4709 5162)
  Abstract:	Stochastic gradient methods have become the workhorse behind many machine learning problems. Despite their success in applications, the theoretical analysis is still not satisfactory. In this talk, I will discuss the learning theory of two representative stochastic gradient methods: stochastic gradient descent and stochastic gradient descent ascent. I will introduce new algorithmic stability concepts to relax the existing restrictive assumptions and to improve the existing learning rates. Our results show new connections between generalization and optimization, which illustrate how a best learning performance can be achieved by early stopping.

All years