lucidrains

lucidrains

👤 Developer

160 repositories on SrcLog

View on GitHub
160 Repos
169.3k Stars
17.1k Forks
11.3k Watchers

🏆 Show off this rank

lucidrains on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

Repositories (160)

perceiver-pytorch lucidrains/perceiver-pytorch Python

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

1.2k
CoCa-pytorch lucidrains/CoCa-pytorch Python

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

1.2k
performer-pytorch lucidrains/performer-pytorch Python

An implementation of Performer, a linear attention-based transformer, in Pytorch

1.2k
tab-transformer-pytorch lucidrains/tab-transformer-pytorch Python

Implementation of TabTransformer, attention network for tabular data, in Pytorch

1.1k
BS-RoFormer lucidrains/BS-RoFormer Python

Implementation of Band Split Roformer, SOTA Attention network for music source separation out of ByteDance AI Labs

1k
muse-maskgit-pytorch lucidrains/muse-maskgit-pytorch Python

Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch

918
RETRO-pytorch lucidrains/RETRO-pytorch Python

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

878
mixture-of-experts lucidrains/mixture-of-experts Python

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

876
meshgpt-pytorch lucidrains/meshgpt-pytorch Python

Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch

862
linear-attention-transformer lucidrains/linear-attention-transformer Python

Transformer based on a variant of attention that is linear complexity in respect to sequence length

845
rotary-embedding-torch lucidrains/rotary-embedding-torch Python

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

827
native-sparse-attention-pytorch lucidrains/native-sparse-attention-pytorch Python

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

816
phenaki-pytorch lucidrains/phenaki-pytorch Python

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

790
TimeSformer-pytorch lucidrains/TimeSformer-pytorch Python

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

731
x-clip lucidrains/x-clip Python

A concise but complete implementation of CLIP with various experimental improvements from recent papers

726
voicebox-pytorch lucidrains/voicebox-pytorch Python

Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch

707
bottleneck-transformer-pytorch lucidrains/bottleneck-transformer-pytorch Python

Implementation of Bottleneck Transformer in Pytorch

678
magvit2-pytorch lucidrains/magvit2-pytorch Python

Implementation of MagViT2 Tokenizer in Pytorch

669
ema-pytorch lucidrains/ema-pytorch Python

A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model

659
MEGABYTE-pytorch lucidrains/MEGABYTE-pytorch Python

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

658
memorizing-transformers-pytorch lucidrains/memorizing-transformers-pytorch Python

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

645
point-transformer-pytorch lucidrains/point-transformer-pytorch Python

Implementation of the Point Transformer layer, in Pytorch

599
pi-zero-pytorch lucidrains/pi-zero-pytorch Python

Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence

589
enformer-pytorch lucidrains/enformer-pytorch Python

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

576
mmdit lucidrains/mmdit Python

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch

564
nuwa-pytorch lucidrains/nuwa-pytorch Python

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

547
classifier-free-guidance-pytorch lucidrains/classifier-free-guidance-pytorch Python

Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models

542
iTransformer lucidrains/iTransformer Python

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group

539
parti-pytorch lucidrains/parti-pytorch Python

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

536
egnn-pytorch lucidrains/egnn-pytorch Python

Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch

535