Professor Steinwart: AI Colloquium der Informatik

April 9, 2019, 3:00 p.m. (CEST)

Professor Steinwart gives a talk at the AI Colloquium der Informatik
University of Stuttgart

Time: April 9, 2019, 3:00 p.m. – 4:00 p.m.
Venue: Machine Learning & Robotics Lab, U Stuttgart
room 2.013
Universitätsstraße 38
Download as iCal:

Title: “A Sober Look at Neural Network Initializations”

Abstract:
Initializing the weights and the biases is a key part of the training process of a neural network. Unlike the subsequent optimization phase, however, the initialization phase has gained only limited attention in the literature. In the first part of the talk, I will discuss some consequences of commonly used initialization strategies for vanilla DNNs with ReLU activations. Based on these insights I will then introduce an alternative initialization strategy, and finally, I will present some large scale experiments assessing the quality of the new initialization strategy.

AI Colloquium UP COMMING TALKS 

List of all events


February 2024

January 2024

December 2023

November 2023

October 2023

November 2023

October 2023

August 2023

July 2023

June 2023

July 2023

June 2023

May 2023

June 2023

May 2023

March 2023

February 2023

January 2023

December 2022

January 2023

December 2022

November 2022

October 2022

September 2022

August 2022

July 2022

June 2022

May 2022

April 2022

March 2022

February 2022

January 2022

February 2022

January 2022

December 2021

October 2021

September 2021

August 2021

July 2021

June 2021

May 2021

April 2021

March 2021

February 2021

January 2021

December 2020

November 2020

October 2020

September 2020

August 2020

July 2020

June 2020

May 2020

April 2020

March 2020

February 2020

January 2020

December 2019

November 2019

October 2019

July 2019

June 2019

July 2019

June 2019

May 2019

October 2020

April 2019

May 2019

April 2019

March 2019

February 2019

January 2019

December 2018

November 2018

September 2018

To the top of the page