rukenx

rukenx

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
1 Stars
0 Forks
0 Watchers

Repositories (1)

attention-by-hand rukenx/attention-by-hand Python

Transformer attention, worked through numerically; from self-attention and RoPE to KV cache, MQA, and GQA.

1