Skip to content
M

microgpt

A visualization of a very small gpt model, running in the browser

Open source

#453in AI
0In stores

Description

microgpt is an interactive visualisation of a very small GPT model that runs in the browser. It is an educational tool for seeing how a lang…

Highlights

  • Interactive tiny GPT in the browser
  • Training and generation controls
  • Weight heatmap and loss display
  • Explanations of attention and RMSNorm
  • Open source code on GitHub

Ratings & Reviews

No ratings yet

Be the first to rate microgpt.

People also visit

G

Gpt2 Webgl

A browser-based, WebGL2 implementation of GPT-2

AI
Launch
L

LLM-Visualized

Interactive 3D and 2D visualization of GPT-2 (124 M)

AI
Launch
P

Perplexity

Interactive language modeling visualization

Reading
Launch
C

ChatLLM-Web

Private local model studio, AI chat

AI
Launch
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

AI Skills
Get
V

vistep.ai

Visualize Every Step with AI — bilingual visual explanations, interactive…

AI
Launch

microgpt FAQ

What is microgpt?

An interactive visualisation of a very small GPT model, running in your browser, for learning how language models work.

What does the model learn?

It learns from a dataset of names and generates new names that look like them.

How do the questions on the page help?

They explain the design choices, such as the number of dimensions and attention heads, and the mechanics of attention, training and normalisation.

Where is the code?

On GitHub at b44ken/microgpt.

What are the best microgpt alternatives?

Popular alternatives to microgpt include Gpt2 Webgl, LLM-Visualized and ChatLLM-Web. See all microgpt alternatives

Developer Stuff

Badges