Skip to content

Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py

Notifications You must be signed in to change notification settings

Hunain0786/miniTransformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

About

Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py

Topics

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages