.`idZddlZddlmZejdejdejdejdejfd ZdS) z.Some utilities for logprobs, including logits.N)current_platformT)dynamicbackendxvaluesreturnc4||kdS)a Counts elements in each row of x that are greater than the corresponding value in values. Use torch.compile to generate an optimized kernel for this function. otherwise, it will create additional copies of the input tensors and cause memory issues. Args: x (torch.Tensor): A 2D tensor of shape (batch_size, n_elements). values (torch.Tensor): A 2D tensor of shape (batch_size, 1). Returns: torch.Tensor: A 1D tensor of shape (batch_size,) with the counts. )sum)rrs o/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/sample/ops/logprobs.pybatched_count_greater_thanr s K  R  )__doc__torchvllm.platformsrcompilesimple_compile_backendTensorr rr rs54 ++++++t%5%LMMM!%,! !!!!NM!!!r