Module grpc_vision_svc::image_captioning::token_output_stream

Structs

• TokenOutputStream
  TokenOutputStream is a wrapper around a tokenizer that allows for streaming tokens to the user rather than waiting for the full decoding to complete.