Back to Reading Room

LA BIBLIOTHÈQUE · READING NOTE

Attention Is All You Need

Vaswani et al.

To Read · 想看

AIPapers基础架构

Transformer, Self-Attention, Attention, Foundation Models

提出 Transformer,完全依赖 Attention 建模序列关系,摆脱 RNN 和 CNN,成为现代大语言模型及大量多模态模型的核心架构基础。