Skip to content
T

Tiny TPU

An attempt to understand and build a TPU—by complete novices

Open source

Domain Rating by Ahrefs13

#236in Design
0In stores

Description

Tiny TPU is a write-up of an attempt by four complete novices to understand and build a tensor processing unit, the kind of accelerator Goog…

Highlights

  • Step-by-step guide to a systolic array
  • Matrix multiplication, bias and activation
  • Pipelining and double buffering explained
  • Animated walkthrough of a forward pass
  • Source code on GitHub

Ratings & Reviews

No ratings yet

Be the first to rate Tiny TPU.

People also visit

T

tilegym-cutile-python

Expert cuTile programming assistant

AI Skills
Get
T

TrenTorch

Don't memorize ML. Understand it from first principles including Inference

Education
Launch
T

tilegym-converting-cutile-to-triton

Converts cuTile GPU kernels (@ct.kernel) to Triton (@triton.jit)

AI Skills
Get
R

Rainbow Tensor

Colourful tensor operation visuals for NumPy style arrays, built for notebooks

Education
Launch
T

tilegym-improve-cutile-kernel-perf

Iteratively optimize cuTile kernel performance through systematic profiling

AI Skills
Get
M

microgpt

A visualization of a very small gpt model, running in the browser

AI
Launch

Tiny TPU FAQ

What is Tiny TPU?

A documented attempt by novices to understand and build a small tensor processing unit for machine learning.

Who made it?

Four authors, Xander Chin, Kenny Guo, Evan Lin and Surya Sure, according to the site.

What will I learn?

How a systolic array does matrix multiplication, how bias and activation fit in, and how pipelining and double buffering work.

Where is the code?

In the tiny-tpu repository on GitHub, linked from the site.

What are the best Tiny TPU alternatives?

Popular alternatives to Tiny TPU include Deep Learning Studio. See all Tiny TPU alternatives

Developer Stuff

Badges