Function candle_transformers::utils::repeat_kv

source ·
pub fn repeat_kv(xs: Tensor, n_rep: usize) -> Result<Tensor>
Expand description

Repeats a key or value tensor for grouped query attention The input tensor should have a shape (batch, num_kv_heads, seq_len, head_dim),