Struct grpc_vision_svc::service_impl::ComputerVisionSvc

pub struct ComputerVisionSvc { /* private fields */ }

The ComputerVisionSvc struct provides methods for processing images. It holds an ImageProcessor instance and a semaphore for limiting concurrent requests.

Implementations

impl ComputerVisionSvc

pub fn new(models: &Models, device: Device) -> CandleResult<Self>

Creates a new instance of ComputerVisionSvc.

This method initializes the image processor and the semaphore for controlling the number of concurrent requests.

Arguments

• models - A reference to the Models struct containing the model configurations.
• device - The device on which the models will be loaded.

Returns

A CandleResult containing the new ComputerVisionSvc instance or an error if initialization fails.

Trait Implementations

impl ComputerVision for ComputerVisionSvc

type ProcessImageBatchStream = ReceiverStream<Result<ImgProcResponse, Status>>

The stream type for the process_image_batch method.

fn process_image<'life0, 'async_trait>( &'life0 self, request: Request<ImgProcRequest> ) -> Pin<Box<dyn Future<Output = Result<Response<ImgProcResponse>, Status>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Processes a single image and returns a description.

This method handles the processing of a single image request by validating the request, acquiring a semaphore permit to limit concurrency, and then spawning a blocking task to perform the actual image processing. The result is then sent back as a gRPC response.

Arguments

• request - A gRPC Request containing the ImgProcRequest.

Returns

A [ResponseResult] containing an ImgProcResponse with the image description or a gRPC Status on error.

Errors

Returns a Status::invalid_argument if the request is invalid, Status::resource_exhausted if too many concurrent requests are being processed, or Status::internal if an error occurs during processing.

fn process_image_batch<'life0, 'async_trait>( &'life0 self, request: Request<Streaming<ImgProcRequest>> ) -> Pin<Box<dyn Future<Output = Result<Response<Self::ProcessImageBatchStream>, Status>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Processes a stream of image requests and returns a stream of responses.

This method handles the processing of a batch of image requests received as a stream. It validates each request, acquires a semaphore permit, and spawns a blocking task for each image processing operation. The responses are sent back as a stream of ImgProcResponse.

Arguments

• request - A gRPC Request containing a Streaming<ImgProcRequest>.

Returns

A [ResponseResult] containing a stream of ImgProcResponse or a gRPC Status on error.

Errors

Returns a Status::resource_exhausted if too many concurrent requests are being processed, or Status::internal if an error occurs during processing.