`iddlmZ ddlZddlZn1#e$r)ZdeevrdndZededededZ[wwxYwde d ej fd Z ej d Z d ej d ej d dfdZded ej d dfdZdS))GuideNnumbanumpyz6To use the kernels in `outlines_core.kernels.numpy`, `z:` must be installed. You can install it with `pip install ` vocab_sizereturncTtjd|dzdzfdtjS)N )dtype)npfullint32)rs o/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/outlines_core/kernels/numpy.pyallocate_token_bitmaskr s4 7 Z"_ #$ h   c|jd}d|z}|jd|kr$tj |dd|df<|ddd|f}|j\}}t|D]`}t|D]N}|||f}|dz} tdD]-} | | z} | |krn|| z dzdkrtj ||| f<.OadS)Nr r r)shaperinfrange) logitsmaskmask_lencutoffn_rowsn_colsimimvalbasebitjs r#_apply_token_bitmask_inplace_kernelr%sz!}H (]F |A fWqqq&''z7F7 #\NFF 6]] + +// + +B2;D7DRyy + +3J;;ES[A%!++$&F7F1a4L + + +rrrc(|jdkr|ntj|d}|jdkr|ntj|d}|jtjkrt d|jd|jdkrt d|jd|jdkrt d |jd|jd|jdkr,t d |jdd |jdd t||d S)ae Apply a logits bitmask inplace, setting the probability of invalid tokens to -infinity. Arguments: logits (np.ndarray): The logits tensor. mask (np.ndarray): The token bitmask representing the validity of each token in the logits tensor. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `np.int32` - `mask` is not a 2D array - `logits` is not a 2D array - `mask.shape`shape does not match `logits.shape` Returns: None: Modifies the mask array in place. r r)axis2Invalid mask dtype: Expected `np.int32`, but got ``.6Invalid mask dimensions: Expected a 2D array, but got D.z8Invalid logits dimensions: Expected a 2D array, but got z.Invalid batch size: Expected `mask.shape[0]` (z) to match `logits.shape[0]` (z).N)ndimr expand_dimsrr ValueErrorrr%)rrs rapply_token_bitmask_inplacer0.sD*{a''VVR^F-K-K-KF9>>44r~d'C'C'CD zRX O O O O    a RTY R R R       Vv{ V V V    A&,q/ ) ) }TZ] } }jpjvwxjy } } }   (55555rguidec|jtjkrtd|jd|jdkrtd|jd|jddkrtd|jd |jd std ||jj |j |j S) am Writes a bitmask to represent the tokens permissible by the current state of the `guide`. Each bit in the bitmask corresponds to a token ID, with a bit value of 1 indicating that the token is allowed and 0 indicating that it is disallowed. This function directly modifies the `mask` array in-place. Arguments: guide (Guide): An instance of the `Guide` class that provides the current guidance state. mask (np.ndarray): A 2D tensor of type `torch.int32` where the bitmask will be written. The tensor must be contiguous, have a single batch dimension (shape[0] == 1), and reside on the CPU. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `torch.int32` - `mask` is not a 2D tensor - `mask` does not have a single batch dimension (shape[0] != 1) - `mask` is not contiguous in memory - `mask` is not on the CPU device Returns: None: Modifies the `mask` array in-place. r(r)r*r+r,rr z_Invalid batch size: Batch mask writes are not supported. Expected shape[0] == 1, but got shape . C_CONTIGUOUSzJMask array must be contiguous in memory. Use `np.ascontiguousarray(mask)`.) rrrr/r-rflagswrite_mask_intoctypesdatasizeitemsize)r1rs rfill_next_token_bitmaskr;Ys0 zRX O O O O    a RTY R R R    A!   {nrnx { { {   Z '  X     !149dm L LLr) outlines_corerrrr ImportErrorestr missing_depintndarrayrnjitr%r0r;rrrEs_ LLL   $A..''GK + W W WIT W W W     srz++ +0(6 (6"*(6(6(6(6(6V)M5)M )Mt)M)M)M)M)M)Ms?$:?