^j[CjUddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z m Z mZmZmZddlmZmZmZddlmZd d lmZd d lmZmZmZmZd d lmZd dl m!Z!e rddl"m#Z#ejHe%Z&e'Z(ee)d<e dZ*ee)d<GddeZ+GddeZ,GddeZ-GddZ.y)N)AsyncExitStack) timedelta)Path) TYPE_CHECKINGAny AsyncIterableLiteralOptional TypedDictUnionoverload) NotRequired TypeAliasUnpack)get_hf_hub_version)AsyncInferenceClient)ChatCompletionInputMessageChatCompletionInputToolChatCompletionStreamOutput'ChatCompletionStreamOutputDeltaToolCall)PROVIDER_OR_POLICY_T) format_result) ClientSessionToolName)stdiossehttp ServerTypecdeZdZUeed<eeeed<eeeefed<eeee dfed<y)StdioServerParameters_TcommandargsenvNcwd) __name__ __module__ __qualname__str__annotations__rlistdictr rt/var/www/ramen.bs-engineer-server.com/venv/lib/python3.12/site-packages/huggingface_hub/inference/_mcp/mcp_client.pyr#r#!s? L d3i  T#s(^ $$ U3d?+ ,,r0r#cReZdZUeed<eeeefed<eeed<eeed<y)SSEServerParameters_Turlheaderstimeoutsse_read_timeoutN) r(r)r*r+r,rr.rfloatr/r0r1r3r3(s0 H c3h ((  !%((r0r3cbeZdZUeed<eeeefed<eeed<eeed<ee ed<y)StreamableHTTPParameters_Tr4r5r6r7terminate_on_closeN) r(r)r*r+r,rr.rrboolr/r0r1r:r:/s; H c3h ((  ##!),,#D))r0r:c *eZdZdZddddddeedeedeedeefdZd Zd Z d Z e d e d de efdZe d e dde efdZe d e dde efdZd edefdZ ddeeeefdeeededeeeeffdZy) MCPClienta Client for connecting to one or more MCP servers and processing chat completions with tools. > [!WARNING] > This class is experimental and might be subject to breaking changes in the future without prior notice. Args: model (`str`, `optional`): The model to run inference with. Can be a model id hosted on the Hugging Face Hub, e.g. `meta-llama/Meta-Llama-3-8B-Instruct` or a URL to a deployed Inference Endpoint or other local or remote endpoint. provider (`str`, *optional*): Name of the provider to use for inference. Defaults to "auto" i.e. the first of the providers available for the model, sorted by the user's order in https://hf.co/settings/inference-providers. If model is a URL or `base_url` is passed, then `provider` is not used. base_url (`str`, *optional*): The base URL to run inference. Defaults to None. api_key (`str`, `optional`): Token to use for authentication. Will default to the locally Hugging Face saved token if not provided. You can also use your own provider API key to interact directly with the provider's service. N)modelproviderbase_urlapi_keyr?r@rArBci|_t|_g|_| | t d||_t |dn|||||_y)NzCAt least one of `model` or `base_url` should be set in `MCPClient`.)r?r@rBrA)sessionsr exit_stackavailable_tools ValueError payload_modelrclient)selfr?r@rArBs r1__init__zMCPClient.__init__KsZ:< (*>@ =X-bc c"*".$E   r0cK|jjd{|jjd{|S7(7w)zEnter the context managerN)rI __aenter__rErJs r1rMzMCPClient.__aenter__bs@kk$$&&&oo((***  '*s!A A !A A A  A cK|jj|||d{|jd{y77w)zExit the context managerN)rI __aexit__cleanup)rJexc_typeexc_valexc_tbs r1rPzMCPClient.__aexit__hs:kk##Hgv>>>lln ?s!AAAAAAcK|jjd{|jjd{y7'7w)zClean up resourcesN)rIcloserEacloserNs r1rQzMCPClient.cleanupms;kk!!!oo$$&&& "&s!A A!A A A  A typerparamsc KywNr/rJrXrYs r1add_mcp_serverzMCPClient.add_mcp_serverrs gjrc Kywr[r/r\s r1r]zMCPClient.add_mcp_serverus cfr^r c Kywr[r/r\s r1r]zMCPClient.add_mcp_serverxs ilr^c Kddlm}m}ddlm}|j dd}|dk(rddlm}tjd|d d |jd gd |d i}d D]} |j| || || <|d$i|} |jj|| d{\} } n|d k(rvddl m } tjd|dd|di}dD]} |j| || || <|jj| d$i|d{\} } n|dk(rwddlm}tjd|dd|di}dD]} |j| || || <|jj|d$i|d{\} } }nt!d||jj|| | |j#dt%d{}tj'd|j)d{|j+d{}tj'd|j,Dcgc]}|j.c}|j,}|z|j,Dcgc]}|j.|vs|}}tj'dt1|dt1|j,d|Dcgc]}|j.c}|D]}|j.|j2vr$tj5d|j.d ?||j2|j.<|j6j9t;j<d!|j.|j>|j@d"d#y7 77777cc}wcc}wcc}ww)%aConnect to an MCP server Args: type (`str`): Type of the server to connect to. Can be one of: - "stdio": Standard input/output server (local) - "sse": Server-sent events (SSE) server - "http": StreamableHTTP server **params (`dict[str, Any]`): Server parameters that can be either: - For stdio servers: - command (str): The command to run the MCP server - args (list[str], optional): Arguments for the command - env (dict[str, str], optional): Environment variables for the command - cwd (Union[str, Path, None], optional): Working directory for the command - allowed_tools (list[str], optional): List of tool names to allow from this server - For SSE servers: - url (str): The URL of the SSE server - headers (dict[str, Any], optional): Headers for the SSE connection - timeout (float, optional): Connection timeout - sse_read_timeout (float, optional): SSE read timeout - allowed_tools (list[str], optional): List of tool names to allow from this server - For StreamableHTTP servers: - url (str): The URL of the StreamableHTTP server - headers (dict[str, Any], optional): Headers for the StreamableHTTP connection - timeout (timedelta, optional): Connection timeout - sse_read_timeout (timedelta, optional): SSE read timeout - terminate_on_close (bool, optional): Whether to terminate on close - allowed_tools (list[str], optional): List of tool names to allow from this server r)rStdioServerParameters)types allowed_toolsNr) stdio_clientz-Connecting to stdio MCP server with command: r$ r%)r%r&r'r) sse_clientz!Connecting to SSE MCP server at: r4)r5r6r7r )streamablehttp_clientz,Connecting to StreamableHTTP MCP server at: )r5r6r7r;zUnsupported server type: zhuggingface_hub.MCPClient)nameversion) read_stream write_stream client_infozInitializing session...zConnected to server with tools:zTool filtering applied. Using z of z available tools: zTool 'z.' already defined by another server. Skipping.function)ri description parameters)rXrnr/)!mcprrbrcpopmcp.client.stdioreloggerinfogetrEenter_async_contextmcp.client.ssergmcp.client.streamable_httprhrGImplementationrdebug initialize list_toolstoolsrilenrDwarningrFappendrparse_obj_as_instancero inputSchema)rJrXrYrrb mcp_typesrdre client_kwargskey server_paramsreadwritergrh_sessionresponsetoolfiltered_toolss r1r]zMCPClient.add_mcp_server{s> =* ?D9  7? 5 KKGyHYGZZ[\b\f\fgmoq\r[st u&y(9:M- 5::c?.)/M#& 52BMBM $ C CLQ^D_ ``KD% U] 1 KK;F5M?K L"F5M2MA 5::c?.)/M#& 5!% C CJD_Q^D_ ``KD% V^ H KKFve}oV W"F5M2MW 5::c?.)/M#& 5$(??#F#FG\Gm_lGm#nnND%8?@ @;;  "%444.05      ./  """!++-- 6x~~8^t8^_"  $/7~~\tmA[d\N\ LL0^1D0ET#hnnJ]I^^pIWrXAErvr{r{rXqYZ # DyyDMM) {2`ab(/DMM$)) $  ' ''== *$(II+/+;+;*.*:*:%   maao   #.8^ ]rXsA7O:6O0N91A O>.O,N<-A O9.O'N?(AO?O,O,O-OO"O'O :#OO1O58O-OB:O<O?OOOO Omessagesexit_loop_toolsexit_if_first_chunk_no_toolreturnc6 K|j}|g||j}|jjjj |j ||ddd{}ddd}i}d}|23d{} |d z }| j r1t| j dkDr| j djnd} | sP| jr| j|d <| jr|d xx| jz cc<| jr| jD]} | j} | |vr3| || <|| jjd|| j_F|| jjd|| j_| jjs|| jxj| jjz c_|r|d krt|dk(ry| 776|d s|r|jd dk(rd |d <|rjg} |j!D]P}| j#|j$d|jj&|jjxsdddR| |d<|j#||j!D]} | jj&}|:t)j*d| j$dd}|j#||V t-j.| jjxsd}n_#t,j0$rI}d| j$|d|d}t)j*|}|j#||Yd}~d}~wwxYwd| j$d|d}|rY||Dcgc]}|jj&ncc}wc}vr-t)j*|}|j#||y|j2j|}|I |j5||d{7}t7||d <n&#t8$r}d||d <Yd}~nd}~wwxYwd||d <t)j*|}|j#||yw)auProcess a query using `self.model` and available tools, yielding chunks and tool outputs. Args: messages (`list[dict]`): List of message objects representing the conversation history exit_loop_tools (`list[ChatCompletionInputTool]`, *optional*): List of tools that should exit the generator when called exit_if_first_chunk_no_tool (`bool`, *optional*): Exit if no tool is present in the first chunks. Default to False. Yields: [`ChatCompletionStreamOutput`] chunks or [`ChatCompletionInputMessage`] objects NautoT)r?rr~ tool_choicestreamunknown)rolecontentrrrrr assistantrnz{})ri arguments)idrXrn tool_callsrz(Invalid tool call with no function name.)r tool_call_idrz%Invalid JSON generated by the model: )rrrir)rrrriz0Error: MCP tool call failed with error message: z"Error: No session found for tool: )rFrIchat completionscreaterHchoicesrdeltarrrindexrnrrvvaluesrrrirrjsonloadsJSONDecodeErrorrD call_toolr Exception)rJrrrr~rmessagefinal_tool_calls num_of_chunkschunkr tool_callidxtool_calls_listtc function_name function_argserr tool_messagetool_message_as_objtrresults r1process_single_turn_with_toolsz(MCPClient.process_single_turn_with_toolss($$  &=o=(<(<=E))55<<$$ =  ,5"DOQ $" " % Q M.3mmEMM@RUV@VEMM!$**\`Ezz"'**}} "emm3"!&!1!1 aI#//C"2209(-+C099CCKGI,S1::D ',55??GCE(-66@ ))33(-66@@IDVDVD`D``@ a +}/AcJZF[_`F`K_ " 8J 9 !1{{6"i/"-8:*113 B#**"$%%$.(* (8(8-/[[-B-B-Jd)  )8 % OOG $*0022 &I%..33M$4JJ &(1 #M(   $ 9+=+=+G+G+O4 P '' "$-LL)!FseL   'A&V&VWc&d# 34)) %+ILLUWanoL=o4^QZZ__4^4^#^&@&V&VWc&d# 34))mm'' 6G"g#*#4#4]M#RRRF.;F.CL+ g0`ad`e.fL+g-O}o*^ Y'#="R"RS_"`  OO/ 0% %e2 &sA R"G8#R2G>6G;7G>:D'R"AR;G>>DR-L10R1N ?NRN  R(OARQ/P20QR Q QRQ:R)NF)r(r)r*__doc__r r+rrKrMrPrQr r rr#r]r3r:r!rr-r r.rrr<rrrr/r0r1r>r>7sI, $37"&!%  } /0  3-  #  .  ' j)9jVLcEdjj ff6J_C`ff llFKeDfll{{s{@DH,1 S&uT#==>?S&"$'>"?@S&&* S& u79SST U S&r0r>)/rlogging contextlibrdatetimerpathlibrtypingrrrr r r r r typing_extensionsrrrutils._runtimer_generated._async_clientr_generated.typesrrrr _providersrutilsrrqr getLoggerr(rtr+rr,r!r#r3r:r>r/r0r1rs %ccc<<0; . !   8 $) 67 I7-i-)I)**T&T&r0