*`is`dZddlZddlmZejdejdejdefdZdS)z'MLX kernel for applying token bitmasks.Nbitmasklogits vocab_sizec,tjdtjt ddggdzD|j}|tj}|dd|f||ddd|fzS) aApply a token bitmask to logits using MLX for Metal GPUs. Args: bitmask: A tensor of shape (batch_size, (vocab_size + 31) // 32) containing the bitmask. Each bit in the bitmask determines whether the corresponding token is allowed (1) or not (0). logits: A tensor of shape (batch_size, vocab_size) containing the logits. Returns: The logits with -inf for tokens that are not allowed. c$g|] }|dddS)N).0ls |/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/xgrammar/kernels/apply_token_bitmask_mlx.py z+apply_token_bitmask_mlx..s"GGGQ44R4GGGz-infr)dtype.N) mxarray itertoolsproductfloatrviewuint8flatten)rrrbitmaps r apply_token_bitmask_mlxrsXGG)+uV}}a.@-AA-EFGGGv|Fll28$$G #{ {" #fWo&=&=b&A&A#{ {BR&S SSr) __doc__rmlx.corecorercompilerintrr rr r!sw--TRXTrxTSTTT TTTr