U ʹj@sddlZddlZddlmZddlmZddlmZee Z dZ dZ dZ dZdeeeeeed ddZddZddZejdddZdS)N)closing) get_loggerzAddress already in usezSocket Timeoutz_tcp_store/num_membersz_tcp_store/last_memberXT) is_server server_addr server_port world_sizetimeoutwait_for_workersc Cs$|dkr$|dkr$td|d||dkr8td||dkrD|nd}|dkrV|}nt}td|||||z 1, got server_port=z , world_size=z+sever_port: %s, specified, ignoring retrieszVCreating c10d store on %s:%s world_size : %s is_server : %s timeout(sec): %s )seconds)Z host_nameportr Z is_masterr r zSuccessfully created c10d storez)port: %s already in use, attempt: [%s/%s]zon z, port: z already in use) ValueErrorloginfo get_free_portdistZTCPStoredatetime timedelta_check_full_rank RuntimeErrorstr_ADDRESS_IN_USEwarning) rr r r r r retriesattemptrstoreer j/var/www/html/bwave/python/venv/lib/python3.8/site-packages/torch/distributed/elastic/utils/distributed.pycreate_c10d_stores^       r"c Csx|td}||kr |tdz|tWnDtk rr}z&t|tkr`td|d|nW5d}~XYnXdS)Nrz ztimed out waiting for all z members to join) add_MEMBER_CHECKINset_LAST_MEMBER_CHECKINgetrr_SOCKET_TIMEOUT TimeoutError)rr idxrr r r!r\s    rc Cs2t}t||dW5QRSQRXdS)Nr)get_socket_with_portr getsockname)sockr r r!rls r)returnc Cstjddtjtjd}|D]x}|\}}}}}t|||}z|d|d|WStk r}z|tj d|dW5d}~XYqXqt ddS) a Returns a free port on localhost that is "reserved" by binding a temporary socket on it. Close the socket before passing the port to the entity that requires it. Usage example :: sock = _get_socket_with_port() with closing(sock): port = sock.getsockname()[1] sock.close() # there is still a race-condition that some other process # may grab this port before func() runs func(port) localhostN)hostrfamilytype)r/rrzSocket creation attempt failed.)exc_infozFailed to create a socket) socket getaddrinfo AF_UNSPEC SOCK_STREAMbindlistenOSErrorcloserrr)addrsaddrr1r2proto_srr r r!r+rs"   "r+)rrrTr)rr4 contextlibrZtorch.distributed distributedrZ'torch.distributed.elastic.utils.loggingr__name__rrr(r$r&boolrintfloatr"rrr+r r r r!s2    C