Distinguished Lecture Series: Jonathan Berant

November 7, 2023, 5:30 p.m. (CET)

Large language models and the age of long texts

Time: November 7, 2023, 5:30 p.m. (CET)
  The talk will take place online on WebEx (link below).
Download as iCal:

The Stuttgart ELLIS Unit is pleased to announce the upcoming ELLIS Distinguished Lecture Series talk by Jonathan Berant (Tel-Aviv University / Google DeepMind)!

Title: Large language models and the age of long texts

Abstract:
The recently demonstrated impressive capabilities of pretrained language
models has whet the appetite of many, and generated wide interest in models that can consume and generate long texts. This interest has raised many questions around modeling of long documents and document collections, as well as around their proper evaluation. In this talk, I will discuss developments in this area, including evaluation of models that consume long texts and the role of retrieval-augmented models in this area. In particular I will characterize some of the difficulties that arise when naively augmenting a language models with retrieved information, and present some recent work on joint training of retrievers and language models.

Bio:
Jonathan Berant is an associate professor at the School of Computer Science at Tel Aviv University, currently on sabbatical as a visiting faculty researcher at Google DeepMind. Jonathan earned a Ph.D. in Computer Science at Tel-Aviv University, and was a post-doctoral fellow at Stanford University, and subsequently a post-doctoral fellow at Google Research, Mountain View. Jonathan has worked in many applied areas of natural language understanding, including semantic parsing, question answering, and textual entailment. Jonathan Received several awards and fellowships including The Rothschild fellowship, The ACL 2011 best student paper award, EMNLP 2014 best paper award, NAACL 2019 best resource paper award, and several honorable mentions. Jonathan has won the Kadar prize for outstanding research and is currently an ERC grantee.

Meeting Link  Google Scholar profile of Prof. Berant  More information 

List of all events


February 2024

January 2024

December 2023

November 2023

October 2023

November 2023

October 2023

August 2023

July 2023

June 2023

July 2023

June 2023

May 2023

June 2023

May 2023

March 2023

February 2023

January 2023

December 2022

January 2023

December 2022

November 2022

October 2022

September 2022

August 2022

July 2022

June 2022

May 2022

April 2022

March 2022

February 2022

January 2022

February 2022

January 2022

December 2021

October 2021

September 2021

August 2021

July 2021

June 2021

May 2021

April 2021

March 2021

February 2021

January 2021

December 2020

November 2020

October 2020

September 2020

August 2020

July 2020

June 2020

May 2020

April 2020

March 2020

February 2020

January 2020

December 2019

November 2019

October 2019

July 2019

June 2019

July 2019

June 2019

May 2019

October 2020

April 2019

May 2019

April 2019

March 2019

February 2019

January 2019

December 2018

November 2018

September 2018

To the top of the page