Module transformer

Transformer module

Structs

PositionWiseFeedForward

Applies the position-wise feed-forward network to the input tensor from the paper Attention Is All You Need.

PositionWiseFeedForwardConfig

Configuration to create a position-wise feed-forward layer using the init function.

PositionWiseFeedForwardRecord

The record type for the module.

PositionWiseFeedForwardRecordItem

The record item type for the module.

TransformerDecoder

The transformer decoder module as describe in the paper Attention Is All You Need.

TransformerDecoderAutoregressiveCache

Autoregressive cache for the Transformer Decoder layer.

TransformerDecoderConfig

Configuration to create a Transformer Decoder layer using the init function.

TransformerDecoderInput

Transformer Decoder forward pass input argument.

TransformerDecoderLayer

Transformer Decoder layer module.

TransformerDecoderLayerRecord

The record type for the module.

TransformerDecoderLayerRecordItem

The record item type for the module.

TransformerDecoderRecord

The record type for the module.

TransformerDecoderRecordItem

The record item type for the module.

TransformerEncoder

The transformer encoder module as describe in the paper Attention Is All You Need.

TransformerEncoderAutoregressiveCache

Autoregressive cache for the Transformer Encoder layer.

TransformerEncoderConfig

Configuration to create a Transformer Encoder layer using the init function.

TransformerEncoderInput

Transformer Encoder forward pass input argument.

TransformerEncoderLayer

Transformer encoder layer module.

TransformerEncoderLayerRecord

The record type for the module.

TransformerEncoderLayerRecordItem

The record item type for the module.

TransformerEncoderRecord

The record type for the module.

TransformerEncoderRecordItem

The record item type for the module.