create

fun create(digits: Int): Tokenizer

Creates a Tokenizer instance based on the number of digits.

Return

A SingleDigitTokenizer for 1-9 digits, or a MultiDigitTokenizer otherwise.

Parameters

digits

The number of digits used for tokenization.