.`iR ddlZddlmZmZddlmZddlmZddlm Z Gddej Z Gdd eZ dS) N)ABCabstractmethod)Iterable) BlockHash) LoadStoreSpeccReZdZdZdejfgZfdZede fdZ xZ S) BlockStatusaW Offloading status for a single block of KV data. Holds the following information: ref_cnt - the current number of transfers using this block as a source. A value of -1 indicates the block is not yet ready to be read. load_store_spec - backend-specific information on how to actually read/write the block. ref_cntcVtd|_dS)N)super__init__r )self __class__s n/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/vllm/v1/kv_offload/backend.pyrzBlockStatus.__init__s$  returnc|jdkS)z@ Returns whether the block is ready to be read. r)r rs ris_readyzBlockStatus.is_readys |q  r) __name__ __module__ __qualname____doc__ctypesc_int32_fields_rpropertyboolr __classcell__)rs@rr r szFN+,H !$!!!X!!!!!rr ceZdZdZdedefdZedZede e de e fdZ ed e fd Z dee d ee defd Zd S)Backendzi An abstract class for allocating and returning specs for writing KV blocks to some backend. block_sizemediumc"||_||_dS)N)r#r$)rr#r$s rrzBackend.__init__+s$ rcdS)zW Returns the number of current number of blocks that can be allocated. Nrs rget_num_free_blockszBackend.get_num_free_blocks/s r block_hashesrcdS)a Allocate space for writing blocks. This method assumes there is enough space for allocation. It is unsafe to use without checking get_num_free_blocks beforehand. Args: block_hashes: the hashes identifying the blocks to be written. Returns: A list of BlockStatus for the allocated blocks. The ref_cnt of each returned item will be -1, meaning the block is not yet ready to be read. Nr')rr)s rallocate_blockszBackend.allocate_blocks6s  rblockcdS)z Free a previously allocated block. You should only call this function with blocks returned by allocate_blocks, and only once per each block. Args: block: The block to be freed. Nr')rr,s rfreez Backend.freeGs  rblocksct)aB Get backend-specific information on how to read/write blocks. Args: block_hashes: the list of block hashes identifying the blocks. blocks: the list of blocks. Returns: A LoadStoreSpec that can be used by a worker to read/write the blocks. )NotImplementedError)rr)r/s rget_load_store_speczBackend.get_load_store_specSs "!rN)rrrrintstrrrr(listrr r+r.rrr2r'rrr"r"%s 3  ^  DO [@Q   ^   +    ^  "$Y/"9A+9N" """"""rr") rabcrrcollections.abcrvllm.v1.core.kv_cache_utilsrvllm.v1.kv_offload.abstractr Structurer r"r'rrr;s ########$$$$$$111111555555!!!!!&"!!!4<"<"<"<"<"c<"<"<"<"<"r