^j ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z  ddl Z ejeZdZddedzfdZGddZy#e $rY1wxYw) N)TextIOctjddtjtj}|D]G}|\}}}}} tj|||}|j d|j d|cStd#t $r(}jtd|Yd}~d}~wwxYw)a Find a free port and binds a temporary socket to it so that the port can be "reserved" until used. .. note:: the returned socket must be closed before using the port, otherwise an ``address already in use`` error will happen. The socket should be held and closed as close to the consumer of the port as possible since otherwise, there is a greater chance of race-condition where a different process may see the port as being free and take it. Returns: a socket bound to the reserved free port Usage:: sock = find_free_port() port = sock.getsockname()[1] sock.close() use_port(port) localhostN)hostportfamilytype)rrrz Socket creation attempt failed: zFailed to create a socket) socket getaddrinfo AF_UNSPEC SOCK_STREAMbindlistenOSErrorcloseprint RuntimeError)addrsaddrrr proto_ses {/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/torch/distributed/elastic/rendezvous/etcd_server.pyfind_free_portrs(    tF,<,<6CUCU E :$(!eQ : fdE2A FF# $ HHQKH : 2 33 : GGI 4QC8 9 9 :s:B  B>B99B>data_dirc|rH|j7tjd|j|j|r.tjd|t j |dyy)Nzstopping etcd serverzdeleting etcd data dir: %sT ignore_errors)pollloggerinfo terminatewaitshutilrmtree) subprocessrs r stop_etcdr(Cs_ojoo'/ *+   0(; hd3c eZdZdZddedzfdZdejfdZde fdZ defdZ defd Z dd e d e d e e zdzddfd Z dded e d e e zdzddfdZdZdd e ddfdZddZy) EtcdServera .. note:: tested on etcd server v3.4.3. Starts and stops a local standalone etcd server on a random free port. Useful for single node, multi-worker launches or testing, where a sidecar etcd server is more convenient than having to separately setup an etcd server. This class registers a termination handler to shutdown the etcd subprocess on exit. This termination handler is NOT a substitute for calling the ``stop()`` method. The following fallback mechanism is used to find the etcd binary: 1. Uses env var TORCHELASTIC_ETCD_BINARY_PATH 2. Uses ``/bin/etcd`` if one exists 3. Uses ``etcd`` from ``PATH`` Usage :: server = EtcdServer("/usr/bin/etcd", 2379, "/tmp/default.etcd") server.start() client = server.get_client() # use client server.stop() Args: etcd_binary_path: path of etcd server binary (see above for fallback path) Nrcd|_d|_tjj t }tjj |d}tjjd||_ tjj|jsd|_ |r|ntjd|_ d|_d|_y)Nrzbin/etcdTORCHELASTIC_ETCD_BINARY_PATHetcdtorchelastic_etcd_data)prefix)_port_hostospathdirname__file__joinenvironget_etcd_binary_pathisfiletempfilemkdtemp_base_data_dir _etcd_cmd _etcd_proc)selfrrootdefault_etcd_bins r__init__zEtcdServer.__init__ns   wwx(77<<j9!# +-=" ww~~d445%+D "!Hh&6&6>V&W 37r)returncH|js td|jS)Nz>No etcd server process started. Call etcd_server.start() first)rArrBs r_get_etcd_server_processz#EtcdServer._get_etcd_server_processs%P ?? "r)c|jS)z)Return the port the server is running on.)r2rHs rget_portzEtcdServer.get_port zzr)c|jS)z)Return the host the server is running on.)r3rHs rget_hostzEtcdServer.get_hostrLr)c8|jd|jS)z,Return the etcd server endpoint (host:port).:)r3r2rHs r get_endpointzEtcdServer.get_endpoints**Qtzzl++r)timeout num_retriesstderrcd} tjj|jt |}tj |d|j |||S#t$ra}|dz }t|jtjd|||k\r"tj|jdYd}~nd}~wwxYw)a Start the server, and waits for it to be ready. When this function returns the sever is ready to take requests. Args: timeout: time (in seconds) to wait for the server to be ready before giving up. num_retries: number of retries to start the server. Each retry will wait for max ``timeout`` before considering it as failed. stderr: the standard error file handle. Valid values are `subprocess.PIPE`, `subprocess.DEVNULL`, an existing file descriptor (a positive integer), an existing file object, and `None`. Raises: TimeoutError: if the server is not ready within the specified timeout rT)exist_okz4Failed to start etcd server, got error: %s, retryingrN)r4r5r8r?strmakedirs_start Exceptionr(rAr!warningr%r&atexitregister)rBrRrSrT curr_retriesrrs rstartzEtcdServer.starts,  77<<(;(;S=NO Ht4{{8Wf== ! $//*JA ;.MM$"5"5TJ/   sAA"" C +ACC cBt}t}|jd|_|jd}tjdj |j dd|dd|jd|jdd|jd|jd d|jd|g }tjd ||j|jtj|d | |_ |j|y) NrW z --enable-v2z --data-dirz--listen-client-urlszhttp://rPz--advertise-client-urlsz--listen-peer-urlszStarting etcd server: [%s]T) close_fdsrT)r getsocknamer2shlexsplitr8r;r3r!r"rr'PopenrA_wait_for_ready)rBrrRrTsock sock_peer peer_portetcd_cmds rrZzEtcdServer._starts"$ %%'* ))+A. ;; HH**! *djj\4::,7-djj\4::,7(djj\9+6   "  0(; $**8tFS W%r)c\tj|j|jddS)zNReturn an etcd client object that can be used to make requests to this server./v2 rrversion_prefix read_timeout)r/Clientr3r2rHs r get_clientzEtcdServer.get_clients%{{$**UQS  r)ctj|j|jdd}t j|z}t j|krh|j j (|j j}td| tjd|jytd#t$rt jdYnwxYwt j|krH)Nrnrpz*Etcd server process exited with the code: zetcd server ready. version: %srWz.Timed out waiting for etcd server to be ready!)r/rsr3r2timerIr returncoderr!r"versionr[sleep TimeoutError)rBrRclientmax_timeexitcodes rrhzEtcdServer._wait_for_readysJJ8t8$#**:*:###,c, &* %I%I%If t# %I  %IPOS&&&)&8;f t8K& &@ MsMDM(8r)r+r)r]loggingr4rer%r r'r=rwtypingrr/ModuleNotFoundError getLoggerrr!rrXr(r+rr)rrsx      8 $"4J4C$J4j8j8o  sAA"!A"