Deep Learning18 min read
Transformer 架构与训练详解
从整体架构、注意力机制到优化器与大规模预训练，系统梳理 Transformer 的组成和训练过程。
Writing
Blog
Formalized essays and longer reflections on the questions that shape my research practice.
A long-term research and learning notebook for posts, notes, papers, projects, and research directions.
Writing
Formalized essays and longer reflections on the questions that shape my research practice.
从整体架构、注意力机制到优化器与大规模预训练，系统梳理 Transformer 的组成和训练过程。