^j dZddlZddlmZddlZddlmZdefdZ de fdZ de fdZ defdZ d ed ed ed eddf d ZdedeefdZddeeej&fdedeeej&ffdZy)zIDistributed-training helpers (world-size, rank, all_gather, reduce_dict).N)AnyreturncXtjsytjsyy)zGReturn True if torch.distributed is available and has been initialised.FT)dist is_availableis_initializedg/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/rfdetr/utilities/distributed.pyis_dist_avail_and_initializedr s#         r c@tsytjS)z@Return the number of processes in the current distributed group.)r rget_world_sizer r r rrs ( *     r c@tsytjS)z@Return the rank of the current process in the distributed group.r)r rget_rankr r r rr&s ( * ==?r ctdk(S)z-Return True if the current process is rank 0.r)rr r r is_main_processr-s :?r objfargskwargscNtrtj||g|i|yy)aSave *obj* to *f* only on the main process (rank 0). Safely saves objects, removing any callbacks that cannot be pickled. Args: obj: Object to save. f: File path or file-like object passed to ``torch.save``. *args: Additional positional arguments forwarded to ``torch.save``. **kwargs: Additional keyword arguments forwarded to ``torch.save``. N)rtorchsave)rrrrs r save_on_masterr2s' 3+D+F+r datacvt}|dk(r|gStjtjj rdnd}t j |}tjt|tj|}|j}tj|g|}t|Dcgc]}tjdg|}}tj|||D cgc]} t| j}} t!|} g} |D]8}| j#tj$| ftj|:|| k7rCtj$| |z ftj|} tj&|| fd}tj| |g} t)|| D]X\} }|j+j-j/d | }| j#t j0|Z| Scc}wcc} w) zRun all_gather on arbitrary picklable data (not necessarily tensors). Args: data: Any picklable object. Returns: List of data gathered from each rank. rcudacpu)dtypedevice)r!r)sizer r!dimN)rrr!rrpickledumpstensor bytearrayuint8numelranger all_gatherintitemmaxappendemptycatziprnumpytobytesloads)r world_sizer!bufferr' local_sizelocal_size_tensor_ size_listr"max_size tensor_listpadding data_lists r r,r,As !JQv \\EJJ$;$;$=&5 IF \\$ F \\)F+5;;v NFJ j\&A;@;LMaqc&1MIMOOI01.78dTYY[!8I89~H K W5;;{%++fUVWX++Hz$9#;5;;W]^FG,!4OOK(II{3/ f##%--/6f-./ +N8s H1< H6 input_dictaveragect}|dkr|Stj5g}g}t|j D]'}|j ||j ||)tj |d}tj||r||z}t||Dcic]\}}|| }}}ddd|Scc}}w#1swYSxYw)a7Reduce values in *input_dict* across all processes. Args: input_dict: Dict whose values will be reduced. average: If True, compute the mean across ranks; otherwise compute the sum. Returns: Dict with the same keys as *input_dict*, with values averaged/summed across ranks. rr#N) rrno_gradsortedkeysr0stackr all_reducer3)rArBr7namesvalueskv reduced_dicts r reduce_dictrOns !JA~  = )* )A LLO MM*Q- ( )V+   j F),UF);<A1< < = = = sB C0 C =C CC)T)__doc__r%typingrrtorch.distributed distributedrboolr r-rrrrlistr,dictstrTensorrOr r r rYsP  t!!# , , ,C ,3 ,4 ,*S*T#Y*ZDell!23ddSVX]XdXdSdNer