neural_tangents.stax.PositionalEmbedding

class neural_tangents.stax.PositionalEmbedding(value)[source]

Type of positional embeddings to use in a GlobalSelfAttention layer.

__init__()

Attributes

NONE

SUM

CONCAT