A long-term research and learning notebook for posts, notes, papers, projects, and research directions.

Theme

#Attention

Entries connected by a shared research or learning theme.

Deep LearningAug 27, 202618 min read

Transformer 架构与训练详解

从整体架构、注意力机制到优化器与大规模预训练，系统梳理 Transformer 的组成和训练过程。