Module tokenizers::models::wordlevel

Structs

• WordLevel
• WordLevelBuilder
  A WordLevelBuilder can be used to create a WordLevel model with a custom configuration.
• WordLevelTrainer
• WordLevelTrainerBuilder
  Builder for WordLevelTrainer.

Enums

• Error
• WordLevelTrainerBuilderError
  Error type for WordLevelTrainerBuilder