^jFR$dZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z dd l mZmZmZmZdd lmZdd lmZmZdd lmZmZdd lmZmZej:eZedZ e jCdgd d|dee"edfdee#eddfdee dzeddfdee#eddfdeddf d Z$d!e"de#fd"Z%e jCd#gd$ d}d!ee"dzed%fd&ee#ed'd(d)fd*ee#ed+d,fd-ee#ed.d/d0fd1ededdfd2Z&d3e"dzd1e"dzd&e#d*e#d-e#de"dzddfd4Z'd!e"d&e#d*e#d-e#de"dzddf d5Z(e jCd6d7d8g d~dee"ed9fdeddfd:Z)e jCd;gd< ddee"ed9fd=ee#ed>d?d@fdAee#edBdCfdeddf dDZ*e jCdEgdF dd!ee"edGfd-ee#ed.d/dHfd=ee#ed>d?d@fdIee#edJdKfdLee+e"dzedMfdNee+e"dzedOfdeddfdPZ,e jCdQgdR d~dSee"edTfdUee"edVfdeddfdWZ-e jCdXgdY ddZee"dzed[fd\ee"dzed]fd;ee#ed^fd_ee#ed`dafdbee#edcddfdeee"dzedffdgee"dzedhfdIee#edJdifdLee+e"dzedjfdNee+e"dzedkfdlee"dzedmfdnee#edodpfdqee#edrdsfdtee#edudvdwfdeddf dxZ.e jCdygdzed{y)z7Contains commands to interact with buckets via the CLI.) AnnotatedN)logging) BUCKET_PREFIX BucketFile FilterMatcher_parse_bucket_uri) REPO_REGIONS) SearchOptTokenOpt get_hf_api typer_factory)make_cp) format_sizeprint_file_listing)ArgumentOption) OutputFormatoutz"Commands to interact with buckets.)helpcreate)zhf buckets create my-bucketz hf buckets create user/my-bucketz-hf buckets create hf://buckets/user/my-bucketz*hf buckets create user/my-bucket --privatez+hf buckets create user/my-bucket --exist-okz,hf buckets create user/my-bucket --region us)nameexamples bucket_idzTBucket ID: bucket_name, namespace/bucket_name, or hf://buckets/namespace/bucket_nameprivatez --privatezCreate a private bucket.regionz--regionzdCloud region in which to create the bucket. Can be one of 'us' or 'eu'. Requires Team plan or above.exist_okz --exist-okz3Do not raise an error if the bucket already exists.tokenreturncrt|}|jtrCt|}|jr t j d|dtd|j}|j||r|nd||}tjd|jj|jy) zCreate a new bucket.rz-Cannot specify a prefix for bucket creation: . Use namespace/bucket_name or namespace/bucket_name.N)rrrzBucket created)uriurl)r startswithrr path_in_repoclick BadParameterid create_bucketrresultr%to_urir&)rrrrrapiparsed bucket_urls f/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/huggingface_hub/cli/buckets.pyrr/sT 5 !CM*"9-   $$? {K11>?UW II """ #J JJZ^^%:%:%<*..Qargumentcd|jtr|ttd}d|vS|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r'rlen)r4paths r2 _is_bucket_idr9ms?=)M*,- $; $;r3z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchc|duxr t|}|r(|tjdt|||||yt ||||||y)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r4r:r;r<r) namespacer=r:r;r<r)r9r)r* _list_files _list_buckets)r4r:r;r<r=r is_file_modes r2list_cmdrCvsgr4'CM(,CL  $$%NO O)   )  r3r?c |rtjd|rtjd|8|jtr#|t td}|j d}t |}|j||Dcgc]T}|j|j|rt|j|n |j|j|jdV}}tj|dd i ycc}w) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr6r")r?r=)r+rsize total_files created_atrEright) alignments)r)r*r'rr7rstripr list_bucketsr+rrrErFrGrtable) r?r=r:r;r<rr/bucketitemss r2rArAs  !JKK  !OPP!5!5m!Dc-023 $$S) 5 !C&&6&J   ))~~@NK ^?UW II I   !)-;;H/I_ a  KK:9+RHcR 5 !CiJ7JJ95r3z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.c:t|}|j|j}|dk(r|stjddd|s|r|stjdt |} |rt jd} g} | j|xsdd D]B} t| ts| j| | jd t| d D| jd t| d |s|r9t|| } | Dcgc] }| j!|j"s|"}}n| }|Dcgc]}|j"}}t%d|D}t'|d }|st j(dyt|d|}|sK|sIt j(dj+d|Dt j,d|ddd|rGt j(dj+fd|Dt j(d|dy| j/|t j0d|ddt||y|}|stjd |r7t j(d!t2d"|t j(d#yt j,d$|d%d|| j/|gt j0d&|'ycc}wcc}w)(zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.r"zListing files from remoteNTrPzListing files from remote (z files))include_patternsexclude_patternsc34K|]}|jywN)rE).0fs r2 zremove..s7A7s)r:zNo files to remove.z file(s) totaling  c3&K|] }d| yw)z N)rlr8s r2rnzremove..sBtD6{BszRemove z from 'r_Fr`c3:K|]}dtd|yw)delete: r6N)r)rlr8rs r2rnzremove..s#cPT- 1TFKcsz (dry run) z would be removed.)r[zRemoved ')r files_deletedrEzFile path cannot be empty.rsr6z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r8r)rr+r(r)r*rrstatusrU isinstancerappendupdater7donermatchesr8sumrtextjoinrabatch_bucket_filesr-r)r4r<r\rcrdrerr0rQr/rv all_filesitemmatcherrm matched_files file_paths total_sizesize_str count_label file_pathrs @r2removerRszx (F I  F |I   k"DDM;b R  7I  !OPP 5 !C78&( (( >T)  UD $ +  & ;C N;K7ST U  1#i.1AIJ g#WwWG(1M1W__QVV5LQMMM%M&34aff4 4777 z$? HH* + Z));H:F 7 HHTYYBzBB C KK'+gi[C O  HHTYYcXbcc d HHz+.@A B  y< {m79+Q 7j/   $$%AB B  HHx yk9+F G HH9 :  hyk)B?SI y)= > YGYN5s L:LLmove)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}|jr tjd|dtdt|}|jr tjd|dtdt |}|j |j|jtjd|j|jy)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: r#r$r")rrz Bucket movedN) rr(r)r*rr move_bucketr+rr-)rrr parsed_from parsed_tor/s r2rrs2$G,K  7yA--:O;Q S  "%(I  7w?--:O;Q S  5 !COOKNN),,O?JJ~{~~Y\\Jr3sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzrs% > #" :(&   H %!EF    0   90R g  0R  +  0R t w   0R*  F  +0R8 90R: ;0R 0RfCD   0    E>  d W  >    7  > $  F  %> 2   C  3> B C> D E> F G> > B 3Tz 3 $J 3 3 3  3 : 3  3Fcccc c : c  c0  (5 " Y   "  "  " "   .  -.6 Y  .6    ,   .6  F  .6, -.6. /.6.6b   6    [H a  H   C  H$    ,   %H4  K  5HB S Dd  CHN S D_  OHZ [H\ ]H HD  *"K  `  "K  e   "K "K "K"KT    &         yrP  d ^   rP  d c   rP  B   rP&  N  'rP4  O  5rPB  d P   CrPN  d 6   OrPZ  H  [rPh S DI  irPt S DI  urP@ d ;  ArPL  T  MrPZ  V  [rPh   8  irPx yrPz {rP rPv    )r3