Module tokenizers::models::bpe::trainer

source ·

Structs§

  • BpeTrainer
    In charge of training a BPE model
  • BpeTrainerBuilder
    A BpeTrainerBuilder can be used to create a BpeTrainer with a custom configuration.