전문가 초청 세미나 개최 안내드리오니 많은 관심과 참여 부탁드립니다. 감사합니다. 

Title: Oversmoothing problem in neural models and recent advances in direct speech to speech translation

Speaker: Dr. Ilia Kulikov, Research Scientist @ Meta AI

Time : 2022 April 12th 10:00 ~ 12:00

Location: 

https://us02web.zoom.us/j/81903892471?pwd=RGtINExpTmMxdVVlN0FOSFJ6SW01QT09 

After the talk, we have an informal Q&A session with Dr. Ilia. Please leave any questions about your research or career. You can listen to answers from Dr. Ilia.

Abstract: 

In the first part of the talk I will discuss the problem of premature translation being assigned a high probability under the model distribution.  We define the oversmoothing rate to quantify this issue. After confirming the high degree of oversmoothing in neural machine translation, we propose to explicitly minimize the oversmoothing rate during training. The proposed notion of oversmoothing explains some of the degeneracies reported earlier, and the proposed mitigation protocol alleviates these degeneracies. In the second part of the talk I will tell about recent approaches to solve direct speech to speech translation tasks, where the goal is to produce a spoken translation without relying on the intermediate text sequences.

Bio:

Dr. Ilia Kulikov is a research scientist at Meta AI where I work on speech translation. He obtained his PhD from New York University in 2022, where he was supervised by Kyunghyun Cho and Jason Weston.