Represents a tokenizer responsible for replacing tokens in sequences and populating layouts.
A tokenizer for sequences with multi-digit tokens.
A tokenizer for sequences with single-digit tokens.
Populates a layout with values from a sequence, replacing tokens as needed.
Replaces tokens in a given sequence using a token map.