^jl""UdZddlmZddlZddlZddlZddlZddlmZddl m Z m Z ddl m Z ddlmZmZmZddlmZddlZddlZdd lmZdd lmZeZerddlZd d d dZdZded<ddZddZ ddZ!GddZ"ddZ#e dddZ$y)zPrivate developer tools for testing and benchmarking RF-DETR. These utilities are intended for internal use by developers and test suites. They are not part of the public API and may change without notice. ) annotationsN) Generator)contextmanagersuppress)Path) TYPE_CHECKINGAnyLiteral) urlretrieve)Image) get_loggerz0http://images.cocodataset.org/zips/train2017.zipz.http://images.cocodataset.org/zips/val2017.zipzFhttp://images.cocodataset.org/annotations/annotations_trainval2017.zip) train2017val2017riint_COCO_VAL_IMAGE_COUNTcr|jsytd|jDtk\S)aCheck whether the COCO val2017 image directory contains the expected number of JPEG files. Returns ``False`` for a missing or empty directory so callers can trigger a re-download without inspecting the directory manually. Args: images_dir: Path to the directory that should contain the val2017 images. Returns: ``True`` if *images_dir* exists and contains at least ``_COCO_VAL_IMAGE_COUNT`` ``.jpg`` files, ``False`` otherwise. Raises: OSError: If *images_dir* exists but cannot be read (e.g. ``PermissionError`` when the directory is not accessible, or ``FileNotFoundError`` on a TOCTOU race between the ``is_dir()`` check and ``iterdir()``). Examples: >>> import tempfile >>> with tempfile.TemporaryDirectory() as tmpdir: ... _coco_val_images_complete(Path(tmpdir) / "val2017") False Fc3~K|]5}|js|jjdk(s2d7yw)z.jpgN)is_filesuffixlower).0entrys c/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/rfdetr/datasets/_develop.py z,_coco_val_images_complete..Fs- f%5==?u||GYGYG[_eGeA fs ===)is_dirsumiterdirr) images_dirs r_coco_val_images_completer +s70     f:--/ ff  !c |jxr|jjdkDS#t$rYywxYw)a"Check whether a file exists and contains at least one byte. Returns ``False`` for a missing or empty file so callers can trigger a re-download without inspecting the file manually. Args: path: Path to the file to check. Returns: ``True`` if *path* refers to an existing file with ``size > 0``, ``False`` otherwise. Examples: >>> import tempfile >>> with tempfile.TemporaryDirectory() as tmpdir: ... _nonempty_file_exists(Path(tmpdir) / "missing.json") False rF)rstatst_sizeOSError)paths r_nonempty_file_existsr'Ks;&||~9$))+"5"5"99 s .1 ==ct|S)zCReturn the official COCO 2017 download URL for the requested asset.) _COCO_URLS)assets rget_coco_download_urlr+ds e r!c*eZdZdZdddZddZd dZy) _SimpleDatasetaHSimple synthetic dataset for testing augmentations and training loops. Creates synthetic images with varying numbers of bounding boxes to test edge cases in augmentation pipelines, particularly the case where num_boxes=2 (which matches orig_size shape [2]). Implements the ``__len__`` / ``__getitem__`` protocol expected by ``torch.utils.data.DataLoader`` without inheriting from ``torch.utils.data.Dataset``, so importing this class does not pull in torch at module load time. Args: num_samples: Number of samples in the dataset. transforms: Optional transforms to apply (e.g., Compose of AlbumentationsWrapper). Examples: >>> from albumentations import HorizontalFlip >>> from torchvision.transforms.v2 import Compose >>> from rfdetr.datasets.transforms import AlbumentationsWrapper >>> >>> transforms = Compose([ ... AlbumentationsWrapper(HorizontalFlip(p=0.5)), ... ]) >>> dataset = _SimpleDataset(num_samples=10, transforms=transforms) >>> image, target = dataset[0] Nc ||_||_yN) num_samples transforms)selfr0r1s r__init__z_SimpleDataset.__init__s&$r!c|jSr/)r0)r2s r__len__z_SimpleDataset.__len__sr!c Btjdd}|dzdz}g}g}t|D]E}d|dzz}d|dzz}|dz} |dz} |j||| | g|j|dzGt j |tj t j |tj t j d d gt j d d gt j |gt j d g|zt j d g|zd} |jr|j|| \}} t jtj|jdd djdz }|| fS)NRGB)r d2P)dtyper9r8gY@r)boxeslabels orig_sizesizeimage_idareaiscrowdgo@)r newrangeappendtorchtensorfloat32int64r1 from_numpynparraypermutefloat) r2idximage num_boxesr@rAix1y1x2y2targets r __getitem__z_SimpleDataset.__getitem__sn %,1WM y! !Aa#gBa"fBbBcB LL"b"b) * MM!a%  !\\%u}}=ll6=sCj1LL#s, cU+LL%9!45||QC)O4  ?? OOE6:ME6  %199!QBHHJURf}r!)r;N)r0rr1z Any | NonereturnNone)r^r)rTrr^z#tuple[torch.Tensor, dict[str, Any]])__name__ __module__ __qualname____doc__r3r5r]r!rr-r-is0% #r!r-c |jdd||jdddz }tjd|t |t |tjd||j }tjt |d5}|jD]}|js||jz j }|j|std |j|jr|jddz|jjdd|j|d5}t|d 5}t!j"||d d d d d d  d d d t%t&5|j)d d d y #1swYExYw#1swY'xYw#1swYKxYw#1swYy xYw) zDownload a zip file and safely extract it into the destination directory. Args: url: URL to a zip archive. dest_dir: Directory where the archive will be saved and extracted. Tparentsexist_ok/rzDownloading %s ...zExtracting %s ...rz"Unsafe path detected in ZIP file: wbN)mkdirrsplitloggerinfor strresolvezipfileZipFileinfolistfilenameis_relative_to RuntimeErrorrparentopenshutil copyfileobjrFileNotFoundErrorunlink) urldest_dirzip_pathdest_dir_resolvedzfmember target_pathsrcdsts r_download_and_extractrs NN4$N/#**S!,R00H KK$c*S]# KK#X. ((* X , 1kkm 1F??,v>GGIK--.?@"%GGZ#[\\}}!!$!>""(((EWWVS)1S${D2I1S&&sC0111 1 1 # $1111 1 1sIB:G G #F> :G  G$G#>G G  G GG #G,c#K|jjddtj} tj|tj tj ztjz}tj| dtt5tj|dddy#t$r@tj|z |kDrtd|tj|YnwxYw#1swYyxYw#tt5tj|dddw#1swYwxYwxYww)aProvide a simple cross-process lock using an exclusive lock file. Args: lock_path: Path to the lock file used for mutual exclusion. timeout_s: Maximum time in seconds to wait for the lock. poll_s: Sleep interval in seconds between lock attempts. Yields: None. The caller runs inside the locked region. Raises: TimeoutError: If the lock cannot be acquired within the timeout. Note: Lock identity is file existence (``O_CREAT | O_EXCL``), not a held file descriptor. A SIGKILL-terminated process will leak the lock file until ``timeout_s`` expires. If all worker processes have exited but the lock persists, remove it manually: ``rm ``. TrfzTimed out waiting for lock: N)ryrmtimeosrzO_CREATO_EXCLO_WRONLYcloseFileExistsError TimeoutErrorsleeprr}r~) lock_path timeout_spoll_sstartfds r_download_lockrs*4$7 IIKE  BJJ$:R[[$HIB HHRL  ! ' ( ! IIi  ! ! yy{U"Y."%A)#MNN JJv    ! !X' ( ! IIi  ! ! !sr3EACEDE&D< EAD E DEDEE.E  E E EE)rrr^bool)r&rr^r)r*z.Literal['train2017', 'val2017', 'annotations']r^rq)rrqrrr^r_)g@g?)rrrrSrrSr^zGenerator[None, Any, None])%rc __future__rrr{rrscollections.abcr contextlibrrpathlibrtypingrr r urllib.requestr numpyrPrKPILr rfdetr.util.loggerr ror)r__annotations__r r'r+r-rrrdr!rrs  # %/..& ) D?[ "s!@2 CCL<%!%!r!