构建编码器层和解码器层

这部分内容有帮助吗？

参考文献

Attention Is All You Need, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin, 2017 Advances in Neural Information Processing Systems (NeurIPS) 30, Vol. 30 (NeurIPS) DOI: 10.5555/3295222.3295349 - 介绍Transformer架构的奠基性论文，涵盖其编码器和解码器层、多头注意力机制、残差连接和层归一化。
Layer Normalization, Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton, 2016 arXiv preprint arXiv:1607.06450 DOI: 10.48550/arXiv.1607.06450 - 介绍并解释了层归一化，这是Transformer层中用于稳定训练的技术。
Speech and Language Processing (3rd ed. draft) - Chapter 10: Transformers and Pretrained Language Models, Daniel Jurafsky and James H. Martin, 2023 - 一份全面的教育资源，解释了Transformer架构，包括编码器和解码器层、自注意力和交叉注意力的详细描述。