^jXdZddlmZmZmZmZddlmZddlm Z ddl m Z GddejZ e ZGd d ejZeZGd d ejZy )a Squeeze-and-Excitation Channel Attention An SE implementation originally based on PyTorch SE-Net impl. Has since evolved with additional functionality / configuration. Paper: `Squeeze-and-Excitation Networks` - https://arxiv.org/abs/1709.01507 Also included is Effective Squeeze-Excitation (ESE). Paper: `CenterMask : Real-Time Anchor-Free Instance Segmentation` - https://arxiv.org/abs/1911.06667 Hacked together by / Copyright 2021 Ross Wightman )OptionalTupleTypeUnion)nn)create_act_layer)make_divisibleceZdZdZdddddej ddddf ded ed eed ed e d e de ejdee ejde e e ejfffd ZdZxZS)SEModule SE Module as defined in original SE-Nets with a few additions Additions include: * divisor can be specified to keep channels % div == 0 (default: 8) * reduction channels can be specified directly by arg (if rd_channels is set) * reduction channels can be specified by float rd_ratio (default: 1/16) * global max pooling can be added to the squeeze aggregation * customizable activation, normalization, and gate layer ?NFTsigmoidchannelsrd_ratio rd_channels rd_divisor add_maxpoolbias act_layer norm_layer gate_layerc h| | d} t |||_|st||z|d}t j ||fd|d| |_|r ||fi| nt j|_t|d|_ t j ||fd|d| |_ t| |_ y)Ndevicedtype round_limitr) kernel_sizerTinplace) super__init__rr rConv2dfc1Identitybnr actfc2gate)selfrrrrrrrrrrrdd __class__s e/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/timm/layers/squeeze_excite.pyr%zSEModule.__init__s / &(H)r?r@rArCrErrGrrrFr%r<rHrIs@r0rKrKEsN !&6D 1 1 1c4 ?23 1#r1rKceZdZdZddddej dddfdeded eed ed e d e ejd e e e ejfffd ZdZxZS)SqueezeExciteClr rNrTrrrrrrrrc || d} t ||st||z|d}tj||fd|i| |_t |d|_tj||fd|i| |_t ||_ y)NrrrrTr") r$r%r rLinearr'r r*r+r,) r-rrrrrrrrrr.r/s r0r%zSqueezeExciteCl.__init__ms / (H)r_s[ 0/(#*#ryy*#Z # #8+##bii##r1