English
← Back to AI Technology

Frameworks and representation

Tokenization

The mapping between raw text and the discrete units processed by a model. Vocabulary construction and segmentation affect sequence length, multilingual coverage, cost, and model behavior.

Reference period
2015 / 2018
Last reviewed

Key terms

  • token
  • vocabulary
  • BPE
  • SentencePiece

Connected across the project

Primary sources

  1. Neural Machine Translation of Rare Words with Subword Units
  2. SentencePiece

This is a curated technical map, not a claim of comprehensive coverage.