Architecture
9 concepts, 9 reviewed and merged.
Blocks
- Decoder-Only TransformerThe original transformer had an encoder that read and a decoder that wrote.verified
- Encoder-DecoderWhen the input and the output are different things — a French sentence and its English translation — one stack can…verified
- Feed-Forward NetworkAttention decides which tokens a position should look at.verified
- Residual ConnectionInstead of asking a layer to produce its output from scratch, a residual connection asks it only for the change, and…verified
- Transformer BlockThe transformer is one block repeated.verified