Struct tokenizers::models::wordpiece::WordPieceBuilder
source · pub struct WordPieceBuilder { /* private fields */ }
Expand description
A WordPieceBuilder
can be used to create a WordPiece
model with a custom configuration.
Implementations§
source§impl WordPieceBuilder
impl WordPieceBuilder
sourcepub fn continuing_subword_prefix(
self,
continuing_subword_prefix: String
) -> Self
pub fn continuing_subword_prefix( self, continuing_subword_prefix: String ) -> Self
Set the prefix for continuing subwords.
sourcepub fn max_input_chars_per_word(self, max_input_chars_per_word: usize) -> Self
pub fn max_input_chars_per_word(self, max_input_chars_per_word: usize) -> Self
Set the maximum number of input characters per word.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for WordPieceBuilder
impl RefUnwindSafe for WordPieceBuilder
impl Send for WordPieceBuilder
impl Sync for WordPieceBuilder
impl Unpin for WordPieceBuilder
impl UnwindSafe for WordPieceBuilder
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more