Positional Encoding

Positional Encoding

sin/cos positional embedding

0 ratings
Free

Rating summary

Details

  • Released
  • Updated
  • August 12, 2025
  • September 15, 2025
Positional Encoding screenshot #1 for iPhone
Positional Encoding screenshot #2 for iPhone
iphone
ipad
๐Ÿ–ผ๏ธGet Icon
Iconsโ†˜๏ธŽ

About

This is an educational App for readers interested in the sin/cos encoding of the token positions in large language models (LLM). Play with this App to acquire a deeper understanding of the positional encoder as it was described in the famous *Attention is All You Need* paper. In particular the App shows how the correlation between two positional vectors depends only on the distance between the corresponding two integer position.
Show more

What's New in Positional Encoding

1.2

September 15, 2025

fixed a bug in dark-mode.

Developer apps