^j (dZddlZddlZddlmZddlmZddlZddlmZddl m Z ddl m Z dd lmZmZdd lmZdd lmZdd lmZdd lmZddlmZmZmZmZmZddlm Z m!Z!ddl"m#Z#m$Z$ddl%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+ddl,m-Z-ej\e/Z0GddejbZ2edeGddeZ3edeGddeZ4edeGdd eZ5ed!eGd"d#eZ6d$Z7d%Z8Gd&d'ejbZ9Gd(d)ejbZ:Gd*d+ejbZ;Gd,d-ejbZ<Gd.d/e'Z=Gd0d1e)Z>Gd2d3e(Z?Gd4d5eZ@eGd6d7e*ZAGd8d9eAZBeGd:d;eAZCed<Gd=d>eAZDed?Gd@dAeAZEedBGdCdDeeAZFgdEZGy)FzPyTorch Swin Transformer model.N)Callable) dataclass)nn)initialization)ACT2FN) BackboneMixinfilter_output_hidden_states)GradientCheckpointingLayer)BackboneOutput)ALL_ATTENTION_FUNCTIONS)Unpack) ModelOutputTransformersKwargsauto_docstringlogging torch_int)can_return_tuplemerge_with_config_defaults)OutputRecordercapture_outputs)PreTrainedModel ViTAttentionViTLayerViTMLPViTPreTrainedModeleager_attention_forward) SwinConfigcreZdZdZd deddffd ZdejdejfdZde fdZ xZ S) SwinDropPathzStochastic depth (DropPath) per sample, for residual blocks. Identity when ``drop_prob`` is 0 or outside training. See `Deep Networks with Stochastic Depth `_. drop_probreturnNc0t|||_yN)super__init__r#)selfr# __class__s p/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/transformers/models/swin/modular_swin.pyr(zSwinDropPath.__init__7s " hidden_statescP|jdk(s |js|Sd|jz }|jdfd|jdz zz}t j ||j |j}t j||z}|j||zS)Nrr)rdtypedevice) r#trainingshapendimtorchrandr1r2floordiv)r)r- keep_probr4 random_tensors r+forwardzSwinDropPath.forward;s >>S   & $$Q')DM4F4F4J,KK 5 0C0CML`L`a  MI$=>   +m;;r,c d|jS)Nzp=)r#)r)s r+ extra_reprzSwinDropPath.extra_reprDsDNN#$$r,)r/) __name__ __module__ __qualname____doc__floatr(r6Tensorr<strr> __classcell__r*s@r+r"r"0sB #%#$#