LLMs-from-scratch

LLMs-from-scratch

rasbt

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

artificial-intelligence deep-learning python machine-learning natural-language-processing
View on GitHub Website
107.9k Stars
16.7k Forks
870 Watchers
Jupyter Notebook Language
other License
100 SrcLog Score
Cost to Build
$73.5K
Market Value
$665.9K
How is this calculated?

Growth over time

8 data points  ·  2025-03-01 → 2026-11-01
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about LLMs-from-scratch

Question copied to clipboard

What is the rasbt/LLMs-from-scratch GitHub project? Description: "Implement a ChatGPT-like LLM in PyTorch from scratch, step by step". Written in Jupyter Notebook. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

🏆 Show off this rank

rasbt/LLMs-from-scratch on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

How to clone LLMs-from-scratch

Clone via HTTPS

git clone https://github.com/rasbt/LLMs-from-scratch.git

Clone via SSH

[email protected]:rasbt/LLMs-from-scratch.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the LLMs-from-scratch issue tracker:

Open GitHub Issues

Similar to LLMs-from-scratch

tensorflow awesome-python system-design-primer flask thefuck free-programming-books-zh_CN cli django requests keras ansible scikit-learn scrapy TensorFlow-Examples certbot pytorch python-patterns tornado face_recognition core pandas CNTK python-guide reddit wechat_jump_game interactive-coding-challenges compose data-science-ipython-notebooks ipython pipenv