Notes

/llm 1 note

Positional Encoding and RoPE

A compact note on sinusoidal positional encoding, its key components, and how that geometry leads to RoPE.