Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
May 23, 2024
·
Amsterdam
Llama 3 Math and Code
A step-by-step walkthrough of a full llama3 implementation, exposing each matrix multiplication, detailing the underlying mathematics and corresponding code in Python.
Overview
I’ve implemented llama3 from scratch, every single matrix multiplication unwrapped and explained!
Links
Implements Llama3 transformer architecture from scratch using PyTorch tensor operations.
Tech stack