Transformers
Tag view
Architecture
Published Discovery and Notes carrying the Architecture tag.
Current observations
Discovery
Durable context
Notes
Transformers
Positional encoding and the encoder-decoder
Where position, masks, residual paths, encoder blocks, and decoder blocks fit in a complete Transformer.