数学科学研究所
Insitute of Mathematical Science

Applied Mathematical Seminar 55: Condensation in deep learning

Seminar| Institute of Mathematical Sciences

Time: TuesdayDecember 19th, 2023 , 13:30-14:30

LocationRS518, IMS

Speaker: Zhiqin Xu, Shanghai JiaoTong University

AbstractWhy do neural network models that look so complex usually generalize well? To understand this problem, we study deep learning training and find that some simple implicit regularization effects. We focus on the condensation phenomenon,which indicates neurons bias towards the same during the training.This talk will discuss the mechanism and potential application of condensation.


地址:上海市浦东新区华夏中路393号
邮编:201210
上海市徐汇区岳阳路319号8号楼
200031(岳阳路校区)