159
Repos
156.6k
Stars
16k
Forks
156.6k
Watchers
Repositories (159)
tf-bind-transformer
lucidrains/tf-bind-transformer
Python
A repository with exploration into using transformers to predict DNA ↔ transcription factor binding
59
6
memformer
lucidrains/memformer
Python
Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
59
4
n-grammer-pytorch
lucidrains/n-grammer-pytorch
Python
Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
56
0
mlp-gpt-jax
lucidrains/mlp-gpt-jax
Python
A GPT, made only of MLPs, in Jax
51
0
omninet-pytorch
lucidrains/omninet-pytorch
Python
Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
47
4
multistream-transformers
lucidrains/multistream-transformers
Python
Implementation of Multistream Transformers in Pytorch
46
1
axial-positional-embedding
lucidrains/axial-positional-embedding
Python
Axial Positional Embedding for Pytorch
44
4
coco-lm-pytorch
lucidrains/coco-lm-pytorch
Python
Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
40
3
molecule-attention-transformer
lucidrains/molecule-attention-transformer
Python
Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle the graph-like structure of molecules
36
4