^ji hUddlmZddlZddlmZddlmZdeefdZdeefdZ eeedzZ ee d<ee Z ee d <ejgZe dd e d edeeej$ej&fee e fffd Zd ej$defdZdeed ej$defdZy)) TypeAliasN)Tensor)no_gradreturncFdddtjjgS)z:Return the device type list that supports foreach kernels.cudaxpumtiatorch_C_get_privateuse1_backend_namee/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/torch/utils/_foreach_utils.py&_get_foreach_kernels_supported_devicesrs E6588#I#I#K LLrcLddddddtjjgS)zEReturn the device type list that supports fused kernels in optimizer.mpsrr hpucpur r rrr$_get_fused_kernels_supported_devicesr s0     ..0 rTensorListListIndicestensorlistlist with_indicescBtjj||SN)r r "_group_tensors_by_device_and_dtype)rrs rrr*s 88 6 6~| TTrdevicecx|jtdgzvxrtjj S)Nr)typerr jit is_scripting)rs r_device_has_foreach_supportr$2s6 >@E7JK ) &&( (rtensorsc@t|xrtd|DS)Nc3JK|]}|duxst|tvywr)r!_foreach_supported_types).0ts r z'_has_foreach_support..:s+7=>T 8T!W 8887s!#)r$all)r%rs r_has_foreach_supportr-9s( &v . 37BI74r)F)typingrr rtorch.autograd.grad_moderliststrrrr__annotations__intrr(booldicttuplerdtyperr$r-rrrr8s ,MS M d3i !ftm!45 5#Y!LL> U"UU % ekk) *E.'2I,J JKU U $v, r