lucidrains

Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch

Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function

An implementation of local windowed attention for language modeling

Implementation of Slot Attention from GoogleAI

Implementation of rectified flow and some of its followup research / improvements in Pytorch

Implementation of RT1 (Robotic Transformer) in Pytorch

Implementation of the convolutional module from the Conformer paper, for use in Transformers

Implementation of Autoregressive Diffusion in Pytorch

Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

Implementation of Q-Transformer, Scalable Offline Reinforcement Learning via Autoregressive Q-Functions, out of Google Deepmind

Implementation of Axial attention - attending to multi-dimensional data efficiently

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

Implementation of the proposed minGRU in Pytorch

Explorations into training LLMs to use clinical calculators from patient history, using open sourced models. Will start with Wells' Criteria

Implementation of Linformer for Pytorch

Explorations into some recent techniques surrounding speculative decoding

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Fully featured implementation of Routing Transformer

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI

Implementation of a U-net complete with efficient attention as well as the latest research findings

Implementation of the Equiformer, SE3/E3 equivariant attention network that reaches new SOTA, and adopted for use by EquiFold for protein folding

Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch