Section: 第19讲 ViT 及注意力机制改进 | 机器学习（2024年春） | 蕴瑜课堂

Side Block Position

Top Block Position

Section outline

•Human knowledge: Local Attention, Big Bird

•Clustering: Reformer

•Learnable Pattern: Sinkforn

•Representative key: Linformer

•k,q first → v,k first: Linear Transformer, Performer

•New framework: Synthesizer
- Select activity 反转课堂mindspore Vision Transformer图像分类代码示例（丘锐））
  
  反转课堂mindspore Vision Transformer图像分类代码示例（丘锐）） URL
  
  Students must
  
  Mark as done
- Select activity 课件19-1 vision transformer
  
  课件19-1 vision transformer File
  
  Students must
  
  Mark as done
- Select activity 课件19 注意力机制改进
  
  课件19 注意力机制改进 File
  
  Students must
  
  Mark as done

Bottom Block Position