
Positional Encoding
sin/cos positional embedding
0 ratings
Free
About
This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM).
Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper.
In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.
Show more
What's New in Positional Encoding
1.2
September 15, 2025
fixed a bug in dark-mode.





