^jmdZddlZddlZddlmZddlmZmZddlm Z ddl m Z ddl m Z mZddlZddlmZd d lmZmZmZmZmZmZmZmZd d lmZmZd d lmZm Z m!Z!m"Z"m#Z#m$Z$d dl%m&Z&m'Z'd dl(m)Z)e$dZ*e dGddZ+ejXdZ-hdZ.hdZ/hdZ0ejXdZ1dddddZ2iZ3e4e0D]Z5e5e3e5<e5de3e5d<e5d e3e5d!<e d"e3e6e7#Z8e dGd$d%Z9e:eedzfZ;ed&eee=efd'e9fd(Z?d)e@d*e@d'e6fd+ZAd&eee=efd'dfd,ZBd-ed'e:effd2ZGd3e6d4e>d'eeedzeHgeEffd5ZId6eHdzd7e6d8eHd'eEfd9ZJd:e6d'e:ee;ge:ed;ffeEffd<ZKd-ed=eFe6d'e+fd>ZLe*jd?gd@A dkdCe e6dze'dDfdEe eEe'dFfdGe eFe6dze'dHdIdJfdKe e8dze'dLfdMe e@dze'dNfd'df dOZNe*jgdPA dld=e eFe6e&dQfdCe e6dze'dDfdRe eEe'dSdTdUfdVe eEe'dWfd'df dXZOe*jdYdZgA dldCe e6dze'dDfdRe eEe'dSdTdUfdVe eEe'dWfd'dfd[ZPe*jgd\Ae jddddBdBdfd]ed^e d_e!dCe e6dze'd`fdae e6dze'dbfdce eEe'dddefdfe eEe'dgdhfdie"d'dfdjZRy)mzHContains the 'hf cache' command group with cache management subcommands.N) defaultdict)CallableMapping) dataclass)Enum) AnnotatedAny)CLIError)ANSICachedRepoInfoCachedRevisionInfo CacheNotFound HFCacheInfo _format_size parse_hf_uriscan_cache_dir)parse_duration parse_size) RepoIdArg RepoTypeOpt RevisionOptTokenOpt get_hf_api typer_factory)ArgumentOption)outzManage local cache directory.)helpT)frozencLeZdZUeeed<eeeefed<e edfed<y)_DeletionResolution revisionsselected.missingN) __name__ __module__ __qualname__ frozensetstr__annotations__dictr rtupled/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/huggingface_hub/cli/cache.pyr#r#2s0~>9-?#@@AA 38_r0r#zA^(?P[a-zA-Z_]+)\s*(?P==|!=|>=|<=|>|<|=)\s*(?P.+)$><=>!=<=>=>refssizetypeaccessedmodified>namer9r;r<z.^(?P[a-zA-Z_]+)(?::(?Pasc|desc))?$descasc)r;r<r9r=z:asc_ascz:desc_desc SortOptions)r:modulec0eZdZUdZeed<eed<eed<y)CacheDeletionCountsz>Simple counters summarizing cache deletions for CLI messaging. repo_countpartial_revision_counttotal_revision_countN)r'r(r)__doc__intr,r/r0r1rErEQsHOr0rEselected_by_reporeturncd}d}d}|jD]H\}}|t|z }t|t|jk(s6|dz }|t|z }J||z }t|||S)z(Summarize deletions across repositories.rr)itemslenr$rE)rKrFtotal_revisionsrevisions_in_full_reposrepor$rGs r1summarize_deletionsrS^sJO+1136i3y>) y>S0 0 !OJ #s9~ 5 # 6 -/FF z+A? SSr0revision_countincomplete_countcg}|r|j|d|r|j|ddj|S)zMBuild the human-readable summary of what `hf cache prune` is about to delete.z unreferenced revision(s)z incomplete download(s) and )appendjoin)rTrUpartss r1_prune_summaryr[psGE ''@AB ())@AB << r0c t|jdD]}|jd|j}t||d}t |t |j k(rt jd|djt jd|d|D]\}djt|jxsd }t jd |jd |d |j^y )zBPretty-print selected cache revisions during confirmation prompts.cN|j|jjfSN repo_typerepo_idlowerrRs r1z0print_cache_selected_revisions..|s$..RVR^R^RdRdRfAgr0key/c|jSr^ commit_hashrevs r1rdz0print_cache_selected_revisions..~ 3??r0 - z (entire repo): z (detached)z z [z] N) sortedkeysr`rarOr$rtextrYr8rjsize_on_disk_str)rKrRrepo_keyr$revisionr8s r1print_cache_selected_revisionsrwzs',,.4gh [nn%Qt||n5+D17RS y>S0 0 HHtH:^4 5  4z#$! [H88F8==12BlD HHvh2232dV2h>W>W=XY Z [ [r0 hf_cache_infoci}i}|jD]Q}|jj}|||<|jD]!}||f||jj<#S||fS)zPCreate lookup tables so CLI commands can resolve repo ids and revisions quickly.)reposcache_idrbr$rj)rx repo_lookuprevision_lookuprRrurvs r1build_cache_indexr~s.0KLNO##M==&&( $ H MH=A8.sQUQ]Q]QcQcQe@fr0rec|jSr^rirks r1rdz'collect_cache_entries..rmr0NcN|dj|d|djfSdfS)Nrr)r{rjentrys r1rdz'collect_cache_entries..s6a!!(-a(<a$$BDr0c |djS)Nr)r{rs r1rdz'collect_cache_entries..suQx'8'8r0)rqrzr*r$r8rXsort)rxrentries repo_refs_map sorted_reposrRrvrefs r1collect_cache_entriesrs!#G!#M---3fgL)'T^^(eW_WdWd(ePS(e(ef d "4>>7RS 1h/0 1 NND$< ( )    M !!  8 9 M !!)fsC exprrc v tj|j}|std|d|j dj |j d|j dj t vr"tdd|dtt d tvr"td d |dttd d k(rt   fd Sdvr>t j dtdtdzdtdtf fd }|Sdk(rG j dk7rtdddtdtdzdtdtffd }|Sdk7rtdd dtdtdzdtdtf fd }|S)zqConvert a `hf cache ls` filter expression into the yes/no test we apply to each cache entry before displaying it.zInvalid filter expression: 'z'.rfopvaluezUnsupported operator 'z ' in filter ''. Must be one of .zUnsupported filter key '' in 'r9cZt||jS|jSr^)_compare_numeric size_on_disk)rRrv_rsize_thresholds r1rdz&compile_cache_filter..s7)9%-%9H ! !  * ?C?P?P  * r0>r;r<rRrvNnowrLcdk(r |jn| |jn |j}|yt||z S)Nr;F) last_accessed last_modifiedr)rRrvr timestamprfrsecondss r1 _time_filterz*compile_cache_filter.._time_filtersW*$""'++''  #C)ORA Ar0r:r3z/Only '=' is supported for 'type' filters. Got 'rc>|jjk(Sr^)r`rb)rRrvrexpecteds r1 _type_filterz*compile_cache_filter.._type_filters>>'')X5 5r0z.Only '=' is supported for 'refs' filters. Got c| |jnj|t}j|Dcgc]}|jc}vScc}wr^)r8getr*rb)rRrvrr8rr value_raws r1 _refs_filterz*compile_cache_filter.._refs_filtersK$,$88==m>O>OPTV_Va>bD??$(E(EE E(EsA)_FILTER_PATTERNmatchstrip ValueErrorgrouprb_ALLOWED_OPERATORSlist _FILTER_KEYSrrr rfloatbool) rrrrrrrrfrrrrs ` @@@@@@r1compile_cache_filterrs  ! !$**, /E 7vR@AA ++e  " " $C T B G$**,I ##1"]4&HZ[_`r[sZttuvww ,3C5tfDVW[\hWiVjjklmm f}#I.   && !23 B~ B9Kd9R BY^ Bcg B f}??$ 9NrdRTUV V 6~ 69Kd9R 6W\ 6ae 6 9MbTQRST T F~ F9Kd9R FW\ Fae Fr0leftrrightcl|y||k(||k7||kD||k||k\||kd}||vrtd|||S)z)Evaluate numeric comparisons for filters.F)r3r5r4r2r7r6z)Unsupported numeric comparison operator: )r)rrr comparisonss r1rrsd |U]em E\ E\emem K DRDIJJ r?r0 sort_expr.c tj|jj}|st d|d|j dj|j d}t vr"t dd|dtt d|r|nt}|d k(}d td ttd fffd }||fS)zConvert a `hf cache ls` sort expression into a key function for sorting entries. Returns: A tuple of (key_function, reverse_flag) where reverse_flag indicates whether to sort in descending order (True) or ascending order (False). zInvalid sort expression: 'z5'. Expected format: 'key' or 'key:asc' or 'key:desc'.rforderzUnsupported sort key 'rrrr>rrL.c|\}}dk(r|jj}|fSdk(r ||j}|fS|j}|fSdk(r |j|j}|fSd}|fSdk(r?| |j|j}|fSd}|fS|j |jnd}|fSt d)Nr=r9r;gr<zUnsupported sort key: )r{rbrrrr)rrRrvrrfs r1 _sort_keyz%compile_cache_sort.._sort_key+s h &=,,.E8O &=-5-AH))E8OHLGXGXE8O * +/*<*<*HD&&E8OORE8O * #2:2H2H2T..8O[^8O/3.@.@.L**RU8O1#788r0) _SORT_PATTERNrrrbrr _SORT_KEYSr_SORT_DEFAULT_ORDER CacheEntryr.r )rrexplicit_orderrreverserrfs @r1compile_cache_sortrs     1 7 7 9 :E 5i[@uvww ++e  " " $C[[)N *1#fYKGYZ^_iZjYkklmnn-N2Ec2JEvoG99c3h9< g r0targetsc(t|\}}tt}t}g}|D]}|j}|s|j } t j d| rZ|j| } | |j|b| \} } || j| |j| j|jt|j } | |j|| jD]1} || j| |j| j3|jD cic]\} }| t|}} }tt||t!|Scc}} w)z8Resolve the deletion targets into a deletion resolution.z[0-9a-fA-F]{40})r$r%r&)r~rsetrrbre fullmatchrrXaddrjrr$rNr*r#r.)rxrr|r}r%r$r& raw_targetrloweredrrRrv matched_reporevsfrozen_selecteds r1_resolve_deletion_targetsrLst#4]#C K>I#>NH%IG0 !!# ,,. <<*G 4#''0E}z*"ND( TN  x ( MM(.. / "'A&'I'O'O'QR   NN: & $.. 0H \ " & &x 0 MM(.. / 0+02@H~~?OPttYt_,POP I& g QsFz list | ls)z hf cache lszhf cache ls --revisionsz*hf cache ls --filter "size>1GB" --limit 20zhf cache ls --format json)examplesF cache_dirz9Cache directory to scan (defaults to Hugging Face cache).r$zCInclude revisions in the output instead of aggregated repositories.filterz-fz--filterzZFilter entries (e.g. 'size>1GB', 'type=model', 'accessed>7d'). Can be used multiple times.raSort entries by key. Supported keys: 'accessed', 'modified', 'name', 'size'. Append ':asc' or ':desc' to explicitly set the order (e.g., 'modified:asc'). Defaults: 'accessed', 'modified', 'size' default to 'desc' (newest/biggest first); 'name' defaults to 'asc' (alphabetical).limitzSLimit the number of results returned. Returns only the top N entries after sorting.c6 t|}|xsg}t ||\}} |D cgc]} t | | } } tj} | D]"} |Dcgc]}| |d|d| s|}}$|r, t|j\}}|j|||#|dkrtjd|d|d|}|r|Dcgc]t\}}|m|j|j|j |j"t|j$|j&|j(t+|j,d v}}}t/j0|gd d d d in|Dcgc]p\}}|j|j|j |j&|j2xsd|j(t+| j5|t7dr}}}t/j0|gddd d i|r|Dchc]\}}| }}}t9|}|r%t;d|D}t;d|D}n$t;d|D}t;d|D}t/j<t?j@d|d|dtC|d|jD}|r9t/jFdt9|dtC|jHdyy#t$r}td|j|d}~wwxYwcc} w#t $r$}tjt||d}~wwxYwcc}w#t $r$}tjt||d}~wwxYwcc}}wcc}}wcc}}w)z&List cached repositories or revisions.Cache directory not found: N)rrr)rfrz&Limit must be a positive integer, got r)rrar`rv snapshot_pathr9rr8)rrvr9rr8rvr9r)headersid_key alignmentsr)rrar`r9rrr8)rr9rrr8rc3,K|] \}}| dyw)Nrr/.0rrls r1 zls..s Lvq#CO Ls c3@K|]\}}| |jywr^rrs r1rzls..sW&!SsS--Ws c3FK|]}t|jywr^)rOr$rrRs r1rzls..s NT^^!4 Ns!c34K|]}|jywr^rrs r1rzls..sH4T..Hz Found z repo(s) for a total of z revision(s) and z on disk.zFound z" incomplete download(s) totalling z$. Remove them with 'hf cache prune'.)%rrr rrrrclick BadParameterr+timerrrr{rar`rjrrtlast_modified_strrqr8rtablelast_accessed_strrr*rOsumrsr boldrincomplete_fileshintincomplete_size_on_disk)rr$rrrrxexcfiltersrrr filter_fnsrfnr sort_key_fnrrRrvrNr unique_reposrFrT total_sizers r1lsrxs^O&y1 lG2=T]^G]4LSTD*4?T T ))+CN&-MUE!HeAh1L5MMN  8#5djj#A K LL['L :   19$$'MeWTU%VW W&5/#*  h#mm<<!^^$00!$X%;%;!< 11!)!;!;x}}-      G(  "#  amm<<!^^--!%!7!7!=2!%!7!7}00y{CD      L(  ,34q4 4&  L LLNWGWWJ N NNNH<HHJ  II:,&>~>NO$Z01<  %55 S)*++MMAABCD1 1 o O4S]]ODE3NOU 4  S*34 N 8$$SX.C 7 8  *  (5sv K5L$LL$M0M;+MA9N 1A5N N5 L>LLL$$ M-M  M N"NN)zhf cache rm model/gpt2z-hf cache rm hf://models/openai-community/gpt2zhf cache rm z hf cache rm model/gpt2 --dry-runzhf cache rm model/gpt2 --yesziOne or more repo IDs (e.g. model/bert-base-uncased), repo-level hf:// URIs, or revision hashes to delete.yesz-yz--yeszSkip confirmation prompt.dry_runz,Preview deletions without removing anything.c L t|}t ||}|j r:dj d|j D}tjd|t|jdk(r5tjdtjjd|jt!|j}t#|j$} g} | j&r| j)| j&d | j*r| j)| j*d | s| j)| j,d d j | } tjd | d |j.dt1|j$|r9tj2dd| j&| j,|j.ytj4d||j7t#|j$} tj2d| j&d| j,d|j.d| j&| j,|j.y#t$r}td|j|d}~wwxYw)z(Remove cached repositories or revisions.rN c3&K|] }d| ywrnNr/)rrs r1rzrm..6sKud5'NKzCould not find in cache: rzNothing to delete.codez repo(s)z revision(s)rWAbout to delete z totalling rDry run: no files were deleted.T)rrzr$r9zProceed with deletion?rDeleted z repo(s) and z revision(s); freed ) repos_deletedrevisions_deletedfreed)rrr rrr&rYrwarningrOr$rsr exceptionsExitdelete_revisionsrqrSr%rFrXrGrHexpected_freed_size_strrwresultconfirmexecute) rrrrrxr resolutiondetailsstrategycounts summary_parts summary_texts r1rmrsVLO&y1 +='BJ))K 8J8JKK 0 :; :   A% %&###++-}--vj6J6J/KLH !4!4 5F!M  1 12(;< $$ = =>lKL  ; ;}t d|jD}|s"|||<|jd|D@|j} t|dk(r| stjdy|jt|} t|} | j |j"z} t%| j&t| } tjd| dt)| d t+||r7tj,d d | j&t| t)|  ytj.d || j1| D]} |j2j5tj,d| dt)| d| j&t| t)| y#t$r}td|j|d}~wwxYw#t6$rYt8$r/}tj:d|j2d|Yd}~d}~wwxYw)zBRemove detached revisions and incomplete downloads from the cache.rNc3RK|]}t|jdk(s|!yw)rN)rOr8rrvs r1rzprune..s!`(HMMHZ^_H_X`s''c34K|]}|jywr^rirs r1rzprune..sG(--GrrzJNo unreferenced revisions or incomplete downloads found. Nothing to prune.r (z total).rT)rr$ incompleter9zProceed?r z!Could not delete incomplete file z: r z; freed r)r incomplete_deletedr )rrr rrrzr*r$updaterrOrrsrrqrSexpected_freed_sizerr[rHrrwrrr file_pathunlinkFileNotFoundErrorOSErrorr)rrrrxrr%r$rRdetachedrrr total_freedsummaryincomplete_files r1pruner.csA0O&y1 EGH%I##H`dnn`` !GhGG H%55 9~#3 ]^-}--vi/@AH  *F..1V1VVKV88#>N:OPGHHy< +D*EX NO"8, -11+,k*   KK $ +` `  % % , , .`JJ 7)8L$=#>a@ 55/0;' ] O4S]]ODE3NOT!   ` KK;O.sF 1V9+[:r!K.9IQRS[Q\P] ^ s$&u<❌ Checksum verification failed for the following file(s): rc3&K|] }d| ywrr/rps r1rzverify..sIq$qc Iru6❌ Missing files (present remotely, absent locally): zM remote file(s) are missing locally. Use --fail-on-missing-files for details.c3&K|] }d| ywrr/r:s r1rzverify.. sGq$qc Gru4❌ Extra files (present locally, absent remotely): zV local file(s) do not exist on the remote repo. Use --fail-on-extra-files for details.zVerification failed for 'z' (z) in z. Revision: z Verified z file(s) for z 'z'. All checksums match.)rar`checkedr5)rerrorrrrrverify_repo_checksumshasattrrr+ mismatchesrYrs missing_pathsrrO extra_paths verified_pathrvr checked_count) rar`rvrr/r0r1r2apir exit_coderverified_locations r1verifyrIsM`!6 WX###++ 5 !C  & &%,Y%@)//c)n 'FI )) &&   PQXPYZ[   iiIF4H4HIIG HHNwiX YI KKv++,-.;;   iiGF4F4FGGG HHLWIV WI KKv))*+,99  ,,A~ 'yIOO3DEJ[I\\klrl{l{k| } ###33JJ F(()y6Gr'Rij//$$ " # r0)NFNNN)NFF)SrIrr collectionsrcollections.abcrr dataclassesrenumrtypingrr rhuggingface_hub.errorsr utilsr r rrrrrrutils._parsingrr _cli_utilsrrrrrr _frameworkrr_outputr cache_clir#compilerrrrrr_sort_options_dictrqrfr+r'rBrEr.rr-r* RepoRefsMaprSrJr[rwr~rrrrrrrrrcommandrrr.modelrIr/r0r1r[sO #-!! +   8``( > ?  $ "**ab6? 5  LM     * 6C!s*-d|#d|$+.%u #e}%6 ="43xP  $>#5#<< = >9S>12 Tni8J.KKLTT$3## [W^YWiMj=j5k [pt [(( n eN$667 78:(" "s "s """6:" 4 [ ()"4> >)> ~1D8%@$FG>B54<S4(3#3%*uSRUX9V0WY]0]*^3l&[&49&Qd&X    GD  d L  D  V  D   S D  m   D * d7   +D <  d f   =D H ID D N *   5O  S |  O d L  O    ,   O* ?  +O6 7OOd -/IJK   )L d L  L    ,   L ?  L* +LLL^ )..   =f fff d k   f d R  f %  %R  !f.#  #_  /f< =f> ?ffr0