Skip to content
#

transformers-architecture

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Python 4 Jupyter Notebook 1

deep-div / Custom-Transformer-Pytorch

Star 16

A clean, ground-up implementation of the Transformer architecture in PyTorch, including positional encoding, multi-head attention, encoder-decoder layers, and masking. Great for learning or building upon the core model.

nlp machine-learning deep-learning transformers pytorch sequence-to-sequence attention-mechanism encoder-decoder self-attention positional-encoding transformers-architecture
  • Updated Aug 30, 2025
  • Jupyter Notebook

Hunain0786 / miniTransformer

Star 0

Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py

python machine-learning natural-language-processing neural-network transformer attention-mechanism large-language-models transformers-architecture
  • Updated Feb 7, 2026
  • Python

Improve this page

Add a description, image, and links to the transformers-architecture topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformers-architecture topic, visit your repo's landing page and select "manage topics."

Learn more