In this talk, we will explore the main milestones in Transformer-based research, and Transformer explainability research. Along the lecture, we will present examples with some of the most famous Transformer-based models such as BERT, CLIP, ViT, DALL-E, and DETR, and discuss the importance and applications of explainability in DNN research, and specifically for Transformers.
Talk starts from 1:00:00.
