`iAddlmZ ddlmZddlZn1#e$r)Zde evrdndZ ede de dedZ[wwxYwde d ej fd Z d Zejd d dgdgeZejdejdejd ejfdZdejdej d ejfdZdedej d dfdZdS))GuideNnumpymlxz3To use the kernels in `outlines_core.kernels.mlx`, z9 must be installed. You can install it with `pip install ` vocab_sizereturncTtjd|dzdzfdtjS)N )dtype)npfullint32)rs m/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/outlines_core/kernels/mlx.pyallocate_token_bitmaskr s4 7 Z"_ #$ h   aC // Batch index uint batch = thread_position_in_grid.y; // Element index uint elem = thread_position_in_grid.x; uint bit = ((elem >> 5) < mask_shape[1]) && ((mask[batch * mask_shape[1] + (elem >> 5)] >> (elem & 31)) & 1); out[batch * inp_shape[1] + elem] = bit ? inp[batch * inp_shape[1] + elem] : -INFINITY; bitmask_apply_batchedinpmaskout)name input_names output_namessourcedatact||gd|jfg|jd|jddfd|jg|jgdS)NTr r)r r )inputstemplategrid threadgroup output_shapes output_dtypes)_KERNELrshape)rrs r_apply_token_bitmask_kernelr))s^ d| #$jmTZ]A .zlzl      rlogitsmask_npctj|}t|jdkr|ntj|d}t|jdkr|ntj|d}|jtjkrtd|jdt|jdkrtd|jdt|jdkrtd |jd|jd|jdkr,td |jdd |jdd t||S) aa Apply a logits bitmask inplace, setting the probability of invalid tokens to -infinity. Arguments: logits (mx.array): The logits tensor. mask (mx.array): The token bitmask representing the validity of each token in the logits tensor. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `mx.int32` - `mask` is not a 2D array - `logits` is not a 2D array - `mask.shape`shape does not match `logits.shape` Returns: None: Modifies the mask array in place. r r)axis2Invalid mask dtype: Expected `np.int32`, but got ``.6Invalid mask dimensions: Expected a 2D array, but got D.z8Invalid logits dimensions: Expected a 2D array, but got z.Invalid batch size: Expected `mask.shape[0]` (z) to match `logits.shape[0]` (z).) mxarraylenr( expand_dimsrr ValueErrorndimr))r*r+rs rapply_token_bitmaskr95sm, 8G  D6<((A--VV2>&q3Q3Q3QFtz??a''44R^Dq-I-I-ID zRX O O O O    TZA   RTY R R R    V\  a   Vv{ V V V    A&,q/ ) ) }TZ] } }jpjvwxjy } } }    'vt 4 44rguidec|jtjkrtd|jd|jdkrtd|jd|jddkrtd|jd |jd std ||jj |j |j S) am Writes a bitmask to represent the tokens permissible by the current state of the `guide`. Each bit in the bitmask corresponds to a token ID, with a bit value of 1 indicating that the token is allowed and 0 indicating that it is disallowed. This function directly modifies the `mask` array in-place. Arguments: guide (Guide): An instance of the `Guide` class that provides the current guidance state. mask (torch.Tensor): A 2D tensor of type `torch.int32` where the bitmask will be written. The tensor must be contiguous, have a single batch dimension (shape[0] == 1), and reside on the CPU. Raises: ValueError: If any of the following conditions are not met: - `mask.dtype` is not `np.int32` - `mask` is not a 2D tensor - `mask` does not have a single batch dimension (shape[0] != 1) - `mask` is not contiguous in memory - `mask` is not on the CPU device Returns: None: Modifies the `mask` tensor in-place. r.r/r0r1r2rr z_Invalid batch size: Batch mask writes are not supported. Expected shape[0] == 1, but got shape . C_CONTIGUOUSzJMask array must be contiguous in memory. Use `np.ascontiguousarray(mask)`.) rrrr7r8r(flagswrite_mask_intoctypesrsizeitemsize)r:rs rfill_next_token_bitmaskrCcs0 zRX O O O O    a RTY R R R    A!   {nrnx { { {   Z '  X     !149dm L LLr) outlines_corermlx.corecorer3rr ImportErrorestr missing_depintndarrayr_KERNEL_SOURCEfast metal_kernelr'compiler4r)r9rCrrrRs    $A..''EK + Sk S SEP S S S     srz  '        bh bh 28     +5+52:+5"(+5+5+5+5\)M5)M )Mt)M)M)M)M)M)Ms A$<A