transformer
===========

.. automodule:: swak.pt.transformer


.. autoclass:: swak.pt.transformer.EncoderLayer
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.transformer.Encoder
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.transformer.Compressor
   :members:
   :show-inheritance:



Attention
---------

.. autoclass:: swak.pt.transformer.MultiheadedSelfAttention
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.transformer.GroupedQuerySelfAttention
   :members:
   :show-inheritance:



Positional encodings
--------------------

.. autoclass:: swak.pt.transformer.Sinusoidal
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.transformer.Rotary
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.transformer.Learnable
   :members:
   :show-inheritance:


Base classes
------------

.. autoclass:: swak.pt.types.PosEnc
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.types.Trafo
   :members:
   :show-inheritance:


.. autoclass:: swak.pt.types.Attn
   :members:
   :show-inheritance: