`i ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z  ddl Z n #e$rYnwxYwejeZdZdde efdZGddZdS) N)OptionalTextIOUnionctjddtjtj}|D]}|\}}}}} tj|||}|d|d|cS#t $r0}|td|Yd}~d}~wwxYwtd)a Find a free port and binds a temporary socket to it so that the port can be "reserved" until used. .. note:: the returned socket must be closed before using the port, otherwise a ``address already in use`` error will happen. The socket should be held and closed as close to the consumer of the port as possible since otherwise, there is a greater chance of race-condition where a different process may see the port as being free and take it. Returns: a socket binded to the reserved free port Usage:: sock = find_free_port() port = sock.getsockname()[1] sock.close() use_port(port) localhostN)hostportfamilytype)rrrz Socket creation attempt failed: zFailed to create a socket) socket getaddrinfo AF_UNSPEC SOCK_STREAMbindlistenOSErrorcloseprint RuntimeError)addrsaddrr r proto_ses /home/jaya/work/projects/VOICE-AGENT/VIET/agent-env/lib/python3.11/site-packages/torch/distributed/elastic/rendezvous/etcd_server.pyfind_free_portrs(   tF,<6CU   E : :$(!eQ : fdE22A FF# $ $ $ HHQKKKHHH : : : GGIII 8Q88 9 9 9 9 9 9 9 9 : 2 3 33sAA>> B8&B33B8data_dirc|rG|j8td|j|j|r3td|t j|ddSdS)Nzstopping etcd serverzdeleting etcd data dir: %sT ignore_errors)pollloggerinfo terminatewaitshutilrmtree) subprocessrs r stop_etcdr*Csojo''/ *+++  4 0(;;; hd33333344c eZdZdZddeefdZdejfdZ de fdZ defdZ defd Z dd e d e dee edfddfdZ dded e dee edfddfdZdZdd e ddfdZddZdS) EtcdServera .. note:: tested on etcd server v3.4.3. Starts and stops a local standalone etcd server on a random free port. Useful for single node, multi-worker launches or testing, where a sidecar etcd server is more convenient than having to separately setup an etcd server. This class registers a termination handler to shutdown the etcd subprocess on exit. This termination handler is NOT a substitute for calling the ``stop()`` method. The following fallback mechanism is used to find the etcd binary: 1. Uses env var TORCHELASTIC_ETCD_BINARY_PATH 2. Uses ``/bin/etcd`` if one exists 3. Uses ``etcd`` from ``PATH`` Usage :: server = EtcdServer("/usr/bin/etcd", 2379, "/tmp/default.etcd") server.start() client = server.get_client() # use client server.stop() Args: etcd_binary_path: path of etcd server binary (see above for fallback path) Nrcd|_d|_tjt }tj|d}tjd||_ tj |j sd|_ |r|ntj d|_ d|_d|_dS)Nrzbin/etcdTORCHELASTIC_ETCD_BINARY_PATHetcdtorchelastic_etcd_data)prefix)_port_hostospathdirname__file__joinenvironget_etcd_binary_pathisfiletempfilemkdtemp_base_data_dir _etcd_cmd _etcd_proc)selfrrootdefault_etcd_bins r__init__zEtcdServer.__init__ns   wx((7<<j99!# +-=" " w~~d455 ,%+D "! WHHh&6>V&W&W&W 6:r+returnc<|jstd|jS)Nz>No etcd server process started. Call etcd_server.start() first)rCrrDs r_get_etcd_server_processz#EtcdServer._get_etcd_server_processs+ #P ? "r+c|jS)z)Return the port the server is running on.)r4rJs rget_portzEtcdServer.get_port zr+c|jS)z)Return the host the server is running on.)r5rJs rget_hostzEtcdServer.get_hostrNr+c$|jd|jS)z,Return the etcd server endpoint (host:port).:)r5r4rJs r get_endpointzEtcdServer.get_endpoints*++tz+++r+<timeout num_retriesstderrcd} tj|jt |}tj|d||||S#t$rm}|dz }t|j t dt |||krtj |jdYd}~nd}~wwxYw)a Start the server, and waits for it to be ready. When this function returns the sever is ready to take requests. Args: timeout: time (in seconds) to wait for the server to be ready before giving up. num_retries: number of retries to start the server. Each retry will wait for max ``timeout`` before considering it as failed. stderr: the standard error file handle. Valid values are `subprocess.PIPE`, `subprocess.DEVNULL`, an existing file descriptor (a positive integer), an existing file object, and `None`. Raises: TimeoutError: if the server is not ready within the specified timeout rT)exist_okz4Failed to start etcd server, got error: %s, retryingr N)r6r7r:rAstrmakedirs_start Exceptionr*rCr#warningr'r(atexitregister)rDrVrWrX curr_retriesrrs rstartzEtcdServer.starts,   7<<(;S=N=NOO Ht4444{{8Wf===   ! $/***JCPQFF ;..M$"5TJJJJ/....   sAA$$ C.A#CCcZt}t}|d|_|d}tjd|jdd|dd|jd|jdd|jd|jd d|jd|g }t d || | tj |d | |_ ||dS) Nr[ z --enable-v2z --data-dirz--listen-client-urlszhttp://rRz--advertise-client-urlsz--listen-peer-urlszStarting etcd server: [%s]T) close_fdsrX)r getsocknamer4shlexsplitr:r=r5r#r$rr)PopenrC_wait_for_ready)rDrrVrXsock sock_peer peer_portetcd_cmds rr^zEtcdServer._starts1"$$ %%''* ))++A. ; HH*! *7dj774:77-7dj774:77(6dj66966     "  0(;;; $*8tFSSS W%%%%%r+cFtj|j|jddS)zNReturn an etcd client object that can be used to make requests to this server./v2 rr version_prefix read_timeout)r1Clientr5r4rJs r get_clientzEtcdServer.get_clients){$*UQS    r+ctj|j|jdd}t j|z}t j|kr|+|j}td| t d|j dS#t$rt j dYnwxYwt j|ktd)Nrrrtz*Etcd server process exited with the code: zetcd server ready. version: %sr[z.Timed out waiting for etcd server to be ready!)r1rwr5r4timerKr" returncoderr#r$versionr_sleep TimeoutError)rDrVclientmax_timeexitcodes rrlzEtcdServer._wait_for_readys Jtz%VW   9;;(ikkH$$,,..3355A88::E"KKK  ;;#;;;;$#**:######,c,,,, +/ %I%I%I%Ic64'( %I  %I%I%I%IPTX&&&&)&8=c64>O8P& &&&&@   MMsMDMMMM(888888r+r-r)raloggingr6rir'r r)r?r{typingrrrr1ModuleNotFoundError getLoggerrr#rr\r*r-rr+rrs-   ********** KKKK   D   8 $ $"4"4"4J44HSM4444j8j8j8j8j8j8j8j8j8j8s 5==