tokenizers
0.15.2
Module whitespace
Structs
In tokenizers::pre_tokenizers
?
Settings
Module
tokenizers
::
pre_tokenizers
::
whitespace
Copy item path
source
·
[
−
]
Structs
§
Whitespace
WhitespaceSplit