Module tokenizers::models::wordpiece

WordPiece model.

Structs

• WordPiece
  A WordPiece model.
• WordPieceBuilder
  A WordPieceBuilder can be used to create a WordPiece model with a custom configuration.
• WordPieceTrainer
  Trains a WordPiece model.
• WordPieceTrainerBuilder
  A WordPieceTrainerBuilder can be used to create a WordPieceTrainer with a custom configuration.

Enums

• Error