Module tokenizers::pre_tokenizers::split

source ·

Structs§

Enums§

  • SplitPattern
    Represents the different patterns that Split can use