Notes / LLM

LLM

Positional Encoding and RoPE

A compact note on sinusoidal positional encoding, its key components, and how that geometry leads to RoPE.