Function candle_core::quantized::ggml_file::qtensor_from_ggml

source · 
pub fn qtensor_from_ggml(
    ggml_dtype: GgmlDType,
    raw_data: &[u8],
    dims: Vec<usize>,
    device: &Device
) -> Result<QTensor>
Expand description

Creates a [Tensor] from a raw GGML tensor.