Function tokenizers::tokenizer::normalizer::bytes_to_char
source · pub fn bytes_to_char(s: &str, range: Range<usize>) -> Option<Range<usize>>
Expand description
Convert the given range from bytes to char
pub fn bytes_to_char(s: &str, range: Range<usize>) -> Option<Range<usize>>
Convert the given range from bytes to char