#

rspa

Here is 1 public repository matching this topic...

SuryaAnything / Recursive-Subword-Pruning-Tokenizer

A high-performance C++ tokenizer using Recursive Sub-word Pruning (RSPA). 38x faster than GPT-4's tiktoken with better morphological segmentation.

nlp tokenizer machine-learning-algorithms trie cpp17 nlp-machine-learning tokenization pybind11 rspa

Updated Jan 17, 2026
Python

Improve this page

Add a description, image, and links to the rspa topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the rspa topic, visit your repo's landing page and select "manage topics."