2 repositories on SrcLog
An implementation of 1D, 2D, and 3D positional encoding in Pytorch and TensorFlow
My take on a practical implementation of Linformer for Pytorch.