^j7HdZddlZddlZddlmZmZmZddlZGddZy)aXPatch-level random erasing augmentation for NaFlex Vision Transformers. This module implements random erasing specifically designed for patchified images, operating at the patch granularity rather than pixel level. It supports two modes: - 'patch': Randomly erases individual patches (speckle-like noise) - 'region': Erases contiguous rectangular regions of patches (similar to original RandomErasing) The implementation is coordinate-aware, respecting valid patch boundaries and supporting variable patch sizes in NaFlex training. Hacked together by / Copyright 2025, Ross Wightman, Hugging Face N)OptionalUnionTupleceZdZdZ ddedededeededed ed eed ed ed ededeee jfddfdZ de jdfdee edfe jfd ee jde j deeee jfde jf dZde jde jde jde e je je jffdZe jfde jde jde jde jde j ddf dZe jfde jde jde jde jde j ddf dZ d de jde jdee jde jfdZdefdZy)!PatchRandomErasingzRandom erasing for patchified images in NaFlex format. Supports two modes: 1. 'patch': Simple mode that erases randomly selected valid patches 2. 'region': Erases rectangular regions at patch granularity N erase_probpatch_drop_prob min_count max_countmin_areamax_area min_aspect max_aspectmodevalue spatial_mode num_splitsdevicereturnc||_||_||_|xs||_||_||_|xsd|z }t j|t j|f|_| |_ | |_ | |_ |jdvsJ| j|_ |jdvsJ| |_d|_y)aInitialize PatchRandomErasing. Args: erase_prob: Probability that the Random Erasing operation will be performed. patch_drop_prob: Patch dropout probability. Remove random patches instead of erasing. min_count: Minimum number of erasing operations. max_count: Maximum number of erasing operations. min_area: Minimum percentage of valid patches/area to erase. max_area: Maximum percentage of valid patches/area to erase. min_aspect: Minimum aspect ratio of erased area (only used in 'region' mode). max_aspect: Maximum aspect ratio of erased area (only used in 'region' mode). mode: Patch content mode, one of 'const', 'rand', or 'pixel'. value: Constant value for 'const' mode. spatial_mode: Erasing strategy, one of 'patch' or 'region'. num_splits: Number of splits to apply erasing to (0 for all). device: Computation device. )patchregion)randpixelconstTN)rr r r r r mathloglog_aspect_ratiorrrlower erase_mode const_valueunique_noise_per_patch)selfrr r r r r rrrrrrrs j/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/timm/data/naflex_random_erasing.py__init__zPatchRandomErasing.__init__sB%.""/i     11z> !%*!5txx 7K L% )  $7777**,"<<<< &*#shape.dtypec|xs |j}|jdk(r&tj|||j St |dk(rdd|dfnd|df}|jdk(s|q|xs |j }t|ttfrtj||||}|Stj|||}tj||}|Stj|||j }|S)aLGenerate values for erased patches based on the specified mode. Args: shape: Shape of patches to erase. value: Value to use in const (or rand) mode. dtype: Data type to use. device: Device to use. Returns: Tensor with values for erasing patches. rr)rrr) rr!torchemptynormal_lenr" isinstanceintfloatfulltensor expand_copy)r$r(rr)r erase_valuevaluess r% _get_valueszPatchRandomErasing._get_valuesWs$&4;; ??g %;;uE&AIIK K),UqQ59%q%)nE')U->#7t'7'7 kC<8"ZZ{%PVWF M #(,,{%PV"WK"..{EBFMU%GOOQMr'patches patch_coord patch_validc Ptj|jkDrytj|ddj }|s|||fSt |}|j rtdt|d|j z z}tjtjd||jd ddd|f}|jd d}|jd|jdjd |j d dz}|||fS) aPatch Dropout. Fully drops patches from datastream. Only mode that saves compute BUT requires support for non-contiguous patches and associated patch coordinate and valid handling. Args: patches: Tensor of patches. patch_coord: Tensor of patch coordinates. patch_valid: Tensor indicating which patches are valid. Returns: Tuple of (patches, patch_coord, patch_valid) with some patches dropped. NTas_tuplerrg?rr-)dim)r-r-)randomrr.nonzerotolistr1r maxr3argsortrandnrsortgather unsqueezeexpandr()r$r;r<r= valid_indices num_validnum_keep keep_indicess r% _drop_patchesz PatchRandomErasing._drop_patcheszs( ==?T__ ,  kDA!DKKM K4 4 &   1c)rD4H4H/H"IJKH ==Q $++)V\^_`acldlcl`lmL',,,4Q7LnnQ (>(>r(B(I(I(U\UbUbcdceUfJf(ghG [00r' patch_shapec tj|jkDrytj|dd}t |}|dk(rytj |j |j}t|tdt||z|jz} tdt||z|jz} tj | | } |tj||jd| } |jr|j dk(r| f|z} n|} |j#| ||| <y) aApply erasing by selecting individual patches randomly. The simplest mode, aligned on patch boundaries. Behaves similarly to speckle or 'sprinkles' noise augmentation at patch size. Args: patches: Tensor of patches to modify in-place. patch_coord: Tensor of patch coordinates. patch_valid: Tensor indicating which patches are valid. patch_shape: Shape of individual patches. dtype: Data type for generated values. NTr?rrrArr))rDrr.rEr1randintr r minrGr3r r randpermrr#r!r:)r$r;r<r=rSr)rNrOcount max_erase min_erase num_erase erase_idx fill_shapes r%_erase_patchesz!PatchRandomErasing._erase_patchess( ==?T__ ,  kDA!D  & > t~~t~~> 3q#i%.?$--.O*P#QR 3y504==@AB NN9i8 "%..7>>"RS]T]"^_  & &4??g+E# 3J$J!--j-F r'c tj|jkDry||}t|dk(ry|dddfjj dz}|dddfjj dz}||} } | | z} |dddf|dddf} } tj |j |j}t|D]}tdD]z}tj|j|j| z}tjtj|j}tt!tj"||z}tt!tj"||z }|| kDs|| kDrtj d| |z }tj d| |z }||z||z}}| |k\| |kz| |k\z| |kz|z}t|j%j }|s@|j&r|j(dk(r|f|z}n|}|j+||||<y)aApply erasing by selecting rectangular regions of patches randomly. Closer to the original RandomErasing implementation. Erases spatially contiguous rectangular regions of patches (aligned with patches). Args: patches: Tensor of patches to modify in-place. patch_coord: Tensor of patch coordinates. patch_valid: Tensor indicating which patches are valid. patch_shape: Shape of individual patches. dtype: Data type for generated values. Nrr rrU)rDrr1rGitemrVr r rangeuniformr r rexprr3roundsqrtsumr#r!r:)r$r;r<r=rSr) valid_coordmax_ymax_xgrid_hgrid_w total_areaysxsrY_attempt target_area aspect_ratiohwtopleftbottomright region_mask num_selectedr^s r% _erase_regionz PatchRandomErasing._erase_regionsG( ==?T__ , "+. { q AqD!%%',,.2AqD!%%',,.2f_ QT"K1$5Bt~~t~~>u% A 9# $nnT]]DMMJZW #xx8M8M(NO dii l(BCDEdii l(BCDEv:VnnQ 3~~a!4 #asrF{3t%(*U 4#$ #;??#4#9#9#;< #..4??g3M".;!>J!,J'+'7'7 %'7'P $G# % r'c|jdk(r|j\}}}}n$|jdk(r|j\}}}} }nJ|jdd} |2tj||ftj|j }|j dkDr||j znd} t| |D]} |jrJd|jd k(r)|j|| || || | |jN|jd k(r)|j|| || || | |jJ|S) aqApply random patch erasing. Args: patches: Tensor of shape [B, N, P*P, C] or [B, N, Ph, Pw, C]. patch_coord: Tensor of shape [B, N, 2] with (y, x) coordinates. patch_valid: Boolean tensor of shape [B, N] indicating which patches are valid. Returns: Erased patches tensor of same shape as input. rCNr+rrzWIP, not completedrr)ndimr(r.onesboolrrrcr rRrr_r)r}) r$r;r<r= batch_size num_patches patch_dimchannelspatch_hpatch_wrS batch_startis r%__call__zPatchRandomErasing.__call__sS <<1 ;B== 8J Y \\Q BI-- ?J Wgx 5mmAB'   **j+%>ejjY`YgYghK8<7JjDOO3PQ {J/ A##222u ""g-##AJNNMM ""h.""AJNNMM u5 8r'c|jjd|jd|jz}|d|jd|j d|j dz }|d|jd|jdz }|S)zReturn string representation of PatchRandomErasing. Returns: String representation of the object. z(p=z, mode=z , spatial=z, area=(z, z))z , count=() __class____name__rr!rr r r r )r$fss r%__repr__zPatchRandomErasing.__repr__Ys ^^ $ $T__,=WT__DU'V V 4,,-Xdmm_Bt}}oUWXX $..)DNN+;2>> r') g?rNg{Gz?gUUUUUU?g333333?Nrrrrcuda)N)r __module__ __qualname____doc__r4r3rstrrr.rr&float32rSizeTensorr)r:rRr_r}rrr'r%rrs!$%('+"# #*. (/58+8+#8+ 8+  } 8+  8+8+8+!8+8+8+8+8+#u||+,8+ 8+z-1!&9= !sCx%**45!ELL)!;; ! U3 #456 !  !F'1\\'1'1 '1 u||U\\5<<7 8 '1^"' ,G\\,G,G ,G  ,G ;; ,G ,Gh"' G\\GG G  G ;; G GZ37 =\\=="%,,/ =  =~ # r'r) rrDrtypingrrrr.rrr'r%rs'  )) MMr'