Pi:~ddlmZmZmZmZddlmZmZGddeeZGddeeZ dS))AnyDictGenericOptional)BaseNodeTcxeZdZdZd deedeffd ZdZde e e ffdZ d e e e ffd Z xZS) LoaderaWraps the root BaseNode (an iterator) and provides a stateful iterable interface. The state of the last-returned iterator is returned by the state_dict() method, and can be loaded using the load_state_dict() method. Args: root (BaseNode[T]): The root node of the data pipeline. restart_on_stop_iteration (bool): Whether to restart the iterator when it reaches the end. Default is True Trootrestart_on_stop_iterationct||_||_d|_d|_d|_dS)NF)super__init__r r _next_iter_state_dict_it_iter_for_state_dict)selfr r __class__s j/home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torchdata/nodes/loader.pyrzLoader.__init__sG  )B&?C"04+0!!!cx|jt||_n|jrd|_|jS|jb|j|jd|_|jr3|js|jdn|jd|jS)NF) initial_state)rLoaderIteratorrrresetr has_nextrs r__iter__zLoader.__iter__"s 8 %d++DHH  & (-D %8O  % 1 HNN)CN D D D)-D &- %dh6G6G6I6I %t$$$ HNN4 xr state_dictc||_dS)zLoads a state_dict which will be used to initialize the next iter() requested from this loader. Args: state_dict (Dict[str, Any]): The state_dict to load. Should be generated from a call to state_dict(). N)r)rrs rload_state_dictzLoader.load_state_dict3s&0"""rreturncn|jt|d|_|jS)a>Returns a state_dict which can be passed to load_state_dict() in the future to resume iteration. The state_dict will come from the iterator returned by the most recent call to iter(). If no iterator has been created, a new iterator will be created and the state_dict returned from it. NT)riterrrrs rrzLoader.state_dict<s3 8  JJJ(,D %x""$$$r)T)__name__ __module__ __qualname____doc__rrboolrrrstrrr r __classcell__rs@rr r s00Xa[0T000000""0$sCx.0000 %DcN % % % % % % % %rr ceZdZdZdZdZdeeffd Zd de e e e fffd Z d efd Zd Zd e e e ffd ZxZS)raAn iterator class that wraps a root node and works with the Loader class. The LoaderIterator object saves state of the underlying root node, and calls reset on the root node when the iterator is exhausted or on a reset call. We look one step ahead to determine if the iterator is exhausted. The state of the iterator is saved in the state_dict() method, and can be loaded on reset calls. Args: loader (Loader[T]): The loader object that contains the root node. num_yieldedr loaderct||_|j|_d|_d|_d|_dSNr)rrr.r _cached_item_cached_state_dict _num_yielded)rr.rs rrzLoaderIterator.__init__WsI  K  <@rNrct||8|j||j||j|_n!|jdd|_d|_dSr0)rrr ROOT_KEYNUM_YIELDED_KEYr3r1)rrrs rrzLoaderIterator.resetbsw  m$$$  $ IOOM$-8 9 9 9 -d.B CD   IOOD ! ! ! !D  rr!c|j? ||_t||_n#t$rYnwxYw|jduSN)r1rr2next StopIterationrs rrzLoaderIterator.has_nextlsa   $ *.//*;*;'$(JJ!!      ,,s-7 AAc|j|j}d|_d|_nt|j}|xjdz c_|S)N)r1r2r9r r3)ritems rr9zLoaderIterator.nextwsL   ($D $D &*D # # ??D Q rcv|j|jS|j|j|j|jiSr8)r2r5r rr6r3rs r get_statezLoaderIterator.get_states>  " .* * M49//11  $"3  rr8)r$r%r&r'r6r5r rrrrr)rrr(rr9r?r*r+s@rrrIs$OH q       !!8DcN#;!!!!!! -$ - - - - 4S>        rrN) typingrrrrtorchdata.nodes.base_noderrr rrrrCs////////////11111111@%@%@%@%@%WQZ@%@%@%F> > > > > Xa[> > > > > r