Module candle_core::quantized::k_quants

Structs

• BlockQ2K
• BlockQ3K
• BlockQ4K
• BlockQ4_0
• BlockQ4_1
• BlockQ5K
• BlockQ5_0
• BlockQ5_1
• BlockQ6K
• BlockQ8K
• BlockQ8_0
• BlockQ8_1

Constants

• K_SCALE_SIZE
• QK4_0
• QK4_1
• QK5_0
• QK5_1
• QK8_0
• QK8_1
• QK_K

Traits

• GgmlType

Functions

• matmul