Pi \ddlmZddlZddlmZmZddlmZGddejZ dS))TupleN)nnTensor) functionalcleZdZdZdededdffd ZdedeeeffdZde fd Z d edefd Z xZ S) VectorQuantizedEmbeddingsa Vector quantized embedding layer that takes in the output of an encoder and performs a nearest-neighbor lookup in the embedding space. Vector quantization was introduced in Oord et al. 2017 (https://arxiv.org/pdf/1711.00937.pdf) to generate high-fidelity images, videos, and audio data. This module currently does not support pre-training of the embeddings via EMA. Code was adapted from torchmultimodal's `Codebook module `_. Args: num_embeddings (int): Number of vectors in the embedding space. embedding_dim (int): Dimensionality of the embedding vectors. num_embeddings embedding_dimreturnNcttjt j|||_||_||_dSN) super__init__r Parametertorchempty embeddingr r )selfr r __class__s s/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchtune/modules/vq_embeddings.pyrz"VectorQuantizedEmbeddings.__init__sN ek.-&P&PQQ,*zc|j\}}}||jkrtd|d|j|d|}t j||jddz}t j|d}||}|||z z}||||} |||} | | fS) a Args: z (Tensor): Tensor containing a batch of encoder outputs of shape ``(b, s, d)``, where b is batch size, s is sequence length or time, and d is ``embedding_dim``. Returns: Tuple[Tensor, Tensor]: The quantized input and the embedding vector ids that were used. Raises: ValueError: if input embedding dimension does not match embedding dimension of module z)Expected last dimension of input tensor (z) to be embedding size of g@)p)dim) shaper ValueErrorviewrcdistrargmindecodedetach) rrbszseq_len z_embed_dimz_flat distancestoken_ids_flatquantized_flat quantized token_idss rforwardz!VectorQuantizedEmbeddings.forward)s%&G!Wk $, , ,wKwwcgcuww  K((K#>>>!C iQ777^44 >F#:"B"B"D"DD#''WkBB "''W55 )##rcBd|j|jS)Nz#num_embeddings={}, embedding_dim={})formatr r )rs r extra_reprz$VectorQuantizedEmbeddings.extra_reprOs%4;;  !3   rr.c6tj||jSr )Fr)rr.s rr$z VectorQuantizedEmbeddings.decodeTs{9dn555r) __name__ __module__ __qualname____doc__intrrrr/strr2r$ __classcell__)rs@rrrs +++  ++++++$$$$E&&.$9$$$$$$$$L C    66666666666rr) typingrrrrtorch.nnrr4Modulerrrr@s $$$$$$H6H6H6H6H6 H6H6H6H6H6r