^j( dZddlmZmZddlmZddlmZmZddl m Z ddl m Z ddl mZmZdd lmZGd d ej$Zd'd Zd(d ZeededededddedddddedddddeddedddZed'defdZed'defdZed'defd Zed'defd!Zed'defd"Zed'defd#Zed'defd$Zed'defd%Zy&))a ResNeSt Models Paper: `ResNeSt: Split-Attention Networks` - https://arxiv.org/abs/2004.08955 Adapted from original PyTorch impl w/ weights at https://github.com/zhanghang1989/ResNeSt by Hang Zhang Modified for torchscript compat, and consistency with timm by Ross Wightman )OptionalType)nnIMAGENET_DEFAULT_MEANIMAGENET_DEFAULT_STD) SplitAttn)build_model_with_cfg)register_modelgenerate_default_cfgs)ResNetc(eZdZdZdZdddddddddddej ejddddddfdeded ed e ejd ed ed ede de de dedede ede ejde ejde e ejde e ejde e ejde ejf&fd Z dZdZxZS)ResNestBottleneckzResNet Bottleneck r N@Finplanesplanesstride downsampleradix cardinality base_widthavd avd_firstis_first reduce_firstdilationfirst_dilation act_layer norm_layer attn_layeraa_layer drop_block drop_pathc ||d}t|| dk(sJ|Jd|Jdt||dz z|z}| xs| } |r |dkDs| r|}d}nd}||_t j ||fddd||_||fi||_|d |_|dkDr| rt jd |d nd|_ |jdk\rgt||fd || | ||||d ||_ t j|_t j|_t j|_nat j ||fd || | |dd||_ ||fi||_||nt j|_|d |_|dkDr| st jd |d nd|_t j ||dzfddd||_||dzfi||_|d |_||_||_y)N)devicedtyper zattn_layer is not supportedzaa_layer is not supportedgP@rF) kernel_sizebiasT)inplace)padding)r)rr-rgroupsrr! drop_layer)r)rr-rr.r*r)super__init__intrrConv2dconv1bn1act1 AvgPool2drr conv2Identitybn2r$act2avd_lastconv3bn3act3rr%)selfrrrrrrrrrrrrrr r!r"r#r$r%r'r(dd group_width avd_stride __class__s ^/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/timm/models/resnest.pyr1zResNestBottleneck.__init__s<0 / q   !@#@@!V_aQ?ei ::?" &'"%%  DJ{{}DH kkmDO DI &'"  DJ"+44DH.8.Djl"++-DO!$/DIBLq.Yb Q A>hl YY{FQJXAEXUWX fqj/B/d+ $"ct|jdd4tjj |jj yy)Nweight)getattrr>rinitzeros_rH)r@s rEzero_init_lastz ResNestBottleneck.zero_init_lastns2 488Xt , 8 GGNN488?? + 9rFcP|}|j|}|j|}|j|}|j|j|}|j |}|j |}|j |}|j|}|j|j|}|j|}|j|}|j|j|}|j|j|}||z }|j|}|SN)r4r5r6rr8r:r$r;r<r=r>r%rr?)r@xshortcutouts rEforwardzResNestBottleneck.forwardrsjjmhhsmiin >> %..%Cjjohhsmooc"iin == $--$Cjjohhsm >> %q!A ?? &q)H xiin rF)__name__ __module__ __qualname____doc__ expansionrReLU BatchNorm2dr2rModuleboolrr1rLrR __classcell__)rDs@rErrsI .2  #" !,0)+*,..482648-1-R#R#R# R# !+ R#  R#R#R#R#R#R#R#R#%SMR#BIIR# RYY!R#"!bii1#R#$tBII/%R#&!bii1'R#(  *)R#h,rFrc &tt||fi|SrN)r r)variant pretrainedkwargss rE_create_resnestras"     rFc 2|dddddttdddd |S) Ni)r,rc)rdg?bilinearzconv1.0fcz apache-2.0) url num_classes input_size pool_sizecrop_pct interpolationmeanstd first_conv classifierlicenser)rgr`s rE_cfgrrs3=vJ%.Bt    rFztimm/) hf_hub_id)r,rt)ru)rsrirj)r,@rv) rwgJ +?bicubic)rsrirjrkrl)r,ry) rzgV-?)rsrl)zresnest14d.gluon_in1kzresnest26d.gluon_in1kzresnest50d.in1kzresnest101e.in1kzresnest200e.in1kzresnest269e.in1kzresnest50d_4s2x40d.in1kzresnest50d_1s4x24d.in1kreturnc zttgddddddtddd  }td d |it|fi|S) z5 ResNeSt-14d model. Weights ported from GluonCV. )r r r r deep Trr Frrrblocklayers stem_type stem_widthavg_downrr block_argsr_) resnest14ddictrrar_r` model_kwargss rErrK R$2STaTU;=L  _J _$|B^W]B^ __rFc zttgddddddtddd  }td d |it|fi|S) z5 ResNeSt-26d model. Weights ported from GluonCV. )rrrrr}r~Trr rFrrr_) resnest26drrs rErrrrFc zttgddddddtddd  }td d |it|fi|S) z ResNeSt-50d model. Matches paper ResNeSt-50 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'd' for deep stem, stem_width 32, avg in downsample. r,rr,r}r~Trr rFrrr_) resnest50drrs rErrsK  R$2STaTU;=L  _J _$|B^W]B^ __rFc zttgddddddtddd }td d |it|fi|S) z ResNeSt-101e model. Matches paper ResNeSt-101 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r,rr,r}rTr rFrrr_) resnest101errs rErrsK  R$2STaTU;=L  `Z `4 C_X^C_ ``rFc zttgddddddtddd }td d |it|fi|S) z ResNeSt-200e model. Matches paper ResNeSt-200 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r,$r,r}rTr rFrrr_) resnest200errs rErrK R$2STaTU;=L  `Z `4 C_X^C_ ``rFc zttgddddddtddd }td d |it|fi|S) z ResNeSt-269e model. Matches paper ResNeSt-269 model, https://arxiv.org/abs/2004.08955 Since this codebase supports all possible variations, 'e' for deep stem, stem_width 64, avg in downsample. )r,0rur}rTr rFrrr_) resnest269errs rErrrrFc zttgddddddtddd }td d |it|fi|S) z]ResNeSt-50 4s2x40d from https://github.com/zhanghang1989/ResNeSt/blob/master/ablation.md rr}r~T(rrrrr_)resnest50d_4s2x40drrs rErrK R$2STaTT:rs"A!*<{ {| %!G4!G4g. F4 HuT]_ HuT]_ $ ! $ !!& ,`f```f```f``avaaavaaavaahfhhhfhhrF