Distinguished Lecture Series: Niao He

May 2, 2023

The Puzzle of Adaptive Gradient Methods for Machine Learning

Time: May 2, 2023
  Universitätstraße 32.101, Campus Vaihingen of the University of Stuttgart. The talk will take place in person.
Download as iCal:

We are pleased to announce our upcoming Distinguished Lecture Series talk by Niao He  (ETH Zurich)! 

The Puzzle of Adaptive Gradient Methods for Machine Learning

A central optimization challenge in machine learning is parameter-tuning. Adaptive gradient methods, such as AdaGrad and Adam, are ubiquitously used for training machine learning models in practice, owing to their ability to adjust the stepsizes without granular knowledge of the loss functions. While these methods have shown remarkable empirical success in training deep neural networks for supervised learning tasks, they often struggle in more challenging scenarios involving adversarial learning, such as adversarial training and generative adversarial networks.  In this talk, we will explore some of the most pressing questions regarding adaptive gradient methods: What are the provable benefits of adaptive methods? How can we improve their robustness and effectiveness for adversarial learning?

No reservation required - we are looking forward to seeing you there!
 
Please note: Professor He will also be available for individual meetings on May 2nd. If you are interested in scheduling a meeting, please email elke.maurer@mathematik.uni-stuttgart.de.
 
Niao He is an Assistant Professor in the Department of Computer Science at ETH Zurich,  where she leads the Optimization and Decision Intelligence (ODI) Group. She is also an ELLIS Scholar and a core faculty member of ETH AI Center, ETH-Max Planck Center of Learning Systems, and ETH Foundations of Data Science. Previously, she was an assistant professor at the University of Illinois at Urbana-Champaign from 2016 to 2020. Before that, she received her Ph.D. degree in Operations Research from Georgia Institute of Technology in 2015. Her research interests are in large-scale optimization, machine learning, and reinforcement learning.  She is a recipient of AISTATS Best Paper Award, NSF CISE Research Initiation Initiative (CRII) Award,  NCSA Faculty Fellowship, and Beckman CAS Fellowship. She regularly serves as an area chair for NeurIPS, ICLR, ICML and other machine learning conferences.
 

 

More information 

List of all events


April 2024

May 2024

April 2024

March 2024

February 2024

January 2024

December 2023

November 2023

October 2023

November 2023

October 2023

August 2023

July 2023

June 2023

July 2023

June 2023

May 2023

June 2023

May 2023

March 2023

February 2023

January 2023

December 2022

January 2023

December 2022

November 2022

October 2022

September 2022

August 2022

July 2022

June 2022

May 2022

April 2022

March 2022

February 2022

January 2022

February 2022

January 2022

December 2021

October 2021

September 2021

August 2021

July 2021

June 2021

May 2021

April 2021

March 2021

February 2021

January 2021

December 2020

November 2020

October 2020

September 2020

August 2020

July 2020

June 2020

May 2020

April 2020

March 2020

February 2020

January 2020

December 2019

November 2019

October 2019

July 2019

June 2019

July 2019

June 2019

May 2019

October 2020

April 2019

May 2019

April 2019

March 2019

February 2019

January 2019

December 2018

November 2018

September 2018

To the top of the page