h8 ddlZddlZddlmZddlmZmZmZmZm Z m Z m Z m Z ddl Z ddlZddlmZddlmZddlmZddlmZddlmZdd lmZdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%dd l&dd l'm(Z(dd l)m*Z*m+Z+ddl,m-Z-eZ.eZ/ dd0e0d'e ee0efd(e ee0efd)e ee0efd*e e e4e jjfd+e e0d,e9fd1Z:e+ d>d0e0d'e ee0efd(e ee0efd)e ee0efd*e e e4e jjfd+e e0d,e e9eeee9fffd2Z;e+ d>d0e0d'e ee0efd(e ee0efd)e ee0efd*e e e4e jjfd+e e0d,e"fd3Zd0e0d'e ee0efd(e ee0efd)e ee0efd*e e e4e jjfd+e e0d,e e"eeee"fffd4Z=e+ d?d0e0d5e e0d6e e0de e e0d7e2d8e d9d'e ee0efd*e e e4e jjfd+e e0d,efd:Z>e+ d?d0e0d5e e0d6e e0de e e0d7e2d8e d9d'e ee0efd*e e e4e jjfd+e e0d,e eeeeefffd;Z?y)@N)partial)Any CoroutineDictIterableListLiteralOptionalUnion)request_timeout)Logging)BaseResponsesAPIConfig)BaseLLMHTTPHandler)&LiteLLMCompletionTransformationHandler)ResponsesAPIRequestUtils) PromptObject ReasoningResponseIncludableResponseInputParam!ResponsesAPIOptionalRequestParamsResponsesAPIResponseResponseTextConfigParam ToolChoice ToolParam)*)GenericLiteLLMParams)ProviderConfigManagerclient)!BaseResponsesAPIStreamingIterator mock_responsectd,iiddddddddd dd dd dd dd ddddddd|gdgdgddddddddddddddd diid!d"gdd#d$d%d&id'd(d&id)d*did+S)-Nid5resp_67ccd2bed1ec8190b14f964abc0542670bb6a6b452d3795bobjectresponse created_atigstatus completederrorincomplete_details instructionsmax_output_tokensmodelzgpt-4.1-2025-04-14outputmessage4msg_67ccd2bf17f0819081ff3bb2cf6508e60bb6a6b452d3795b assistant output_text)typetext annotations)r4r#r(rolecontentparallel_tool_callsTprevious_response_id reasoning)effortsummarystore temperatureg?r5formatr4 tool_choiceautodisabled$ cached_tokensrWreasoning_tokens{) input_tokensinput_tokens_details output_tokensoutput_tokens_details total_tokens)toolstop_p truncationusageusermetadata)rr!s R/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/responses/main.pymock_responses_api_responserW)sU . , I, j,  *,  k , T , !$ ,  D,  ,  ),  %P)'%2$1+-  , 2 "43, 4 #D5, 6 DT:7, 8 T9, : 3;, < X/0=, > 6?, @$ ")8!( backgroundstreamr?r5rArNrOrP)rBrCrR extra_headers extra_query extra_bodytimeoutcustom_llm_providerreturncJKddlm}|j|\}}g}g}|r;|jd}|j |d{}|j |}|s|r||znd} id|d|d|d|d |d |d | d | d | d| d| d|d|d|d|d|d|||||d|}!t d||| |d|!d{}"|rt|"tr|j|r|j|"}#|#r|jdijd}|j|#|d{}$|$rc|j|"|$|}%|jd|%|| |"jd|!d{}&t|&tr|j|&||$}&|&S|"S7R77p73w) a Async version of responses API with MCP integration. When MCP tools with server_url="litellm_proxy" are provided, this function will: 1. Get available tools from the MCP server manager 2. Insert the tools into the messages/input 3. Call the standard responses API 4. If require_approval="never" and tool calls are returned, automatically execute them rLiteLLM_Proxy_MCP_Handleruser_api_key_authNrZr,r-r[rSr9r;r>r\r]r?r5rArOrPrRr^)r_r`rarb)rYr.rNr:)mcp_tools_with_litellm_proxy)r&litellm_metadata) tool_callsrg)r& tool_resultsoriginal_input)follow_up_inputr. all_tools response_id)r&mcp_tools_fetchedrkrT)/litellm.responses.mcp.litellm_proxy_mcp_handlerrf_parse_mcp_toolsget_get_mcp_tools_from_manager_transform_mcp_tools_to_openai aresponses isinstancer_should_auto_execute_tools!_extract_tool_calls_from_response_execute_tool_calls_create_follow_up_input_make_follow_up_callr#$_add_mcp_output_elements_to_response)'rYr.rZr,r-r[rSr9r:r;r>r\r]r?r5rArNrOrPrRr^r_r`rarbkwargsrfrh other_tools openai_toolsrprgrn call_paramsr&rjrkrmfinal_responses' rVaresponses_api_with_mcpr\sP 1J0Z0Z[`0a- +L#"JJ':;";"W"WXi"jj0OOPab 0<{ {*QUI7  . &  H  2  Y  j & {  {  j !" #$# 2+, -K6 1   H %812!<%c%c!/*;%1&d&N &% OYkD K"sJAF#F A1F#:F;A3F#.F/>F#-F!.-F#F#F#!F#c"Kt} tj}d|d<|,tj||j dd\}}}}t tfid|d|d|d |d |d |d |d |d|d| d| d| d| d| d|d|d|d|d|d|d|d|d|d|d||}tj}t |j|}|jd|d{} tj| r | d{}!n| }!t|!tr(tj |!|j di| }!|!t#d!|!|!S7p7S#t$$r}"tj&|||"||"d}"~"wwxYww)#zS Async: Handles responses API requests by reusing the synchronous function TrvNbase_url)r.api_baserYr.rZr,r-r[rSr9r:r;r>r\r]r?r5rArNrOrPrRr^r_r`rarbriresponses_api_responserirbz8Got an unexpected None response from the Responses API: r.rboriginal_exceptioncompletion_kwargs extra_kwargs)localsasyncioget_event_looplitellmget_llm_providerrsr responses contextvars copy_contextrunrun_in_executor iscoroutinerwrr/_update_responses_api_response_id_with_model_id ValueError Exceptionexception_type)#rYr.rZr,r-r[rSr9r:r;r>r\r]r?r5rArNrOrPrRr^r_r`rarbr~ local_varsloop_funcctxfunc_with_context init_responser&es# rVrvrvsOFJD %%'#|  &+2+C+CjnnZ&F, (A"Aq      &  0    !4 "6    "  $ ! "$# $% &' (") *+ ,(- .$/ 0"1 23 4!47 <&&(#CGGT2"2249JKK   } -**H$H h 4 5/__'/!',>!C$7H  WX`Wabc c%L+  $$ 3 (    sN FC!E$/E 0E$E"AE$F E$"E$$ F -FF  Fc ddlm}t} |jd}|jdd}|j dddu}t di|}|j r0t|j trt|j Stj|||j|j \}}} }!|j| r tdi|St!j"|tj$| }"|j'|t)j*|}#|"t-j.d|||#||| d |St)j0||"|#}$|j3||t5|$d|i|$|t6j/|||"|$||||||xst8||jd|"j;|| ||jdi}%t|%t<r(t)j>|%|jdi|}%|%S#t@$r}&tjB|||&||d}&~&wwxYw)zk Synchronous version of the Responses API. Uses the synchronous HTTP handler to make requests. rrelitellm_logging_objlitellm_call_idNrvFTrU)r.rbrapi_key)rNr.provider)r.rYresponses_api_requestrb _is_asyncr])r.responses_api_provider_configresponse_api_optional_params)r.rRoptional_paramslitellm_paramsrbr)r.r]rbri)r.rYr$response_api_optional_request_paramsrbr logging_objr^r`rarr fake_streamrirrrT)"rqrfrrspoprr!rwstrrWrrrr_should_use_litellm_mcp_gatewayrr!get_provider_responses_api_config LlmProvidersupdater)get_requested_response_api_optional_param)litellm_completion_transformation_handlerresponse_api_handler!get_optional_params_responses_apiupdate_environment_variablesdictbase_llm_http_handlerr should_fake_streamrrrr)'rYr.rZr,r-r[rSr9r:r;r>r\r]r?r5rArNrOrPrRr^r_r`rarbr~rfrrrrrdynamic_api_keydynamic_api_baserrresponses_api_request_paramsr&rs' rVrrKsHJy 17!?.!4 9 )==*G1M 3)+'!.::h'5HHF@SI$ZZ(:B?!> ( h 4 5/__'/!',>!C$7H   $$ 3 (    s-A=HAHA-H CH I'IIroc 0Kt} tj}d|d<tj|} | j dxs|}| j dxs|}t tf||||||d|} tj} t | j| } |jd| d{} tj| r | d{}|S| }|S7)7 #t$r}tjd||||d}~wwxYww) zz Async version of the DELETE Responses API DELETE /v1/responses/{response_id} endpoint in the responses API Tadelete_responsesrororbrorbr^r_r`raNr)rrrr!_decode_responses_api_response_idrsrdelete_responsesrrrrrrrrror^r_r`rarbr~rrdecoded_response_idrrrrr&rs rVrrsE&J* %%'&*"# % F F'   *--m<K  # #$9 : Q>Q    # 3'#!    &&(#CGGT2"2249JKK   } -**H%H L+  $$ 3 (    sY DB/C+=C'>C+C)C+"D#C+&D'C+)C++ D4DDDc t} |jd}|jdd} |jdddu} tdi|} t j |} | jdxs|}| jd xs|}| t d tjdtj| } | t d ||j||jdd|id| i| tj||| | ||||xst| |jd }|S#t $r}tj"d||||d}~wwxYw)z Synchronous version of the DELETE Responses API DELETE /v1/responses/{response_id} endpoint in the responses API rrNrFTrrorb2custom_llm_provider is required but passed as Nonerz&DELETE responses is not supported for r.rrrbr rorbrrrr^r`rarrrrT)rrsrrrrrrrrrrrrdelete_response_api_handlerr rrror^r_r`rarbr~rrrrrrrr&rs rVrr1s&JG 17Q   &QR R " C C --.AB  & ) 089L8MN  &! 88{"?!4 9 )DD# 3*G)+'!.::h'E    $$ 3 (    sD*D77 EEEc Kt} tj}d|d<tj|} | j dxs|}| j dxs|}t tf||||||d|} tj} t | j| } |jd| d{} tj| r | d{}n| }t|tr(tj||j di| }|S7`7C#t $r}t#j$d|||| d}~wwxYww) ax Async: Fetch a response by its ID. GET /v1/responses/{response_id} endpoint in the responses API Args: response_id: The ID of the response to fetch. custom_llm_provider: Optional provider name. If not specified, will be decoded from response_id. Returns: The response object with complete information about the stored response. Taget_responsesrrorbrNrirr)rrrrrrsr get_responsesrrrrrrwrrrrrrs rVrrsp2J2 %%'#'  % F F'   *--m<K  # #$9 : Q>Q    # 3'#!    &&(#CGGT2"2249JKK   } -**H$H h 4 5/__'/!',>!C$7H L+  $$ 3 (    sN E B/D"=D>D"D AD"E D" D"" E +EE  E c 4t} |jd}|jdd} |jdddu} tdi|} t j |} | jdxs|}| jd xs|}| t d tjdtj| } | t d ||j||jdd|id| i| tj||| | ||||xst| |jd }t!|t"r(t j$||jdi|}|S#t&$r}tj(d||||d}~wwxYw)aq Fetch a response by its ID. GET /v1/responses/{response_id} endpoint in the responses API Args: response_id: The ID of the response to fetch. custom_llm_provider: Optional provider name. If not specified, will be decoded from response_id. Returns: The response object with complete information about the stored response. rrNrFTrrorbrrz#GET responses is not supported for rrrrirrrT)rrsrrrrrrrrrrrrrr rwrrrrrs rVrrs2JO 17Q   &QR R " C C --.AB  & ) 056I5JK  &! 88{"?!4 9 )66# 3*G)+'!.::h'7   h 4 5/__'/!',>!C$7H   $$ 3 (    sE"E// F8FFafterbeforelimitorder)ascdescc 6Kt} tj} d| d<tj|} | j dxs|}| j dxs|}t tf|||||||||d | } tj}t |j| }| jd|d{}tj|r |d{}|S|}|S7)7 #t$r}tjd||| | d}~wwxYww) z&Async: List input items for a responseTalist_input_itemsrrorb) rorrrZrrr^rarbNr)rrrrrrsrlist_input_itemsrrrrrrrr)rorrrZrrr^rarbr~rrrrrrrr&rs rVrrJsNJ, %%'&*"# % F F'   *--m<K  # #$9 : Q>Q    #' 3    &&(#CGGT2"2249JKK   } -**H%H L+  $$ 3 (    sY DB2C.C*C.C, C.%D&C.)D*C.,C.. D7DDDc  t} | jd} | jdd} | jdddu} tdi| }t j |}|jdxs|}|jd xs|}| t d tjdtj| }|t d || j| | jdd|id| i| tj||||| |||||||xst| | jd}|S#t $r}tj"d||| | d}~wwxYw)zList input items for a responserrNrFTrrorbrrz&list_input_items is not supported for rr)rorbrrrrrrZrrr^rarrrrT)rrsrrrrrrrrrrrrlist_responses_input_itemsr rr)rorrrZrrr^rarbr~rrrrrrrr&rs rVrrsJB 17Q   &QR R " C C --.AB  & ) 089L8MN  &!88*K8-? 3 9 )CC# 3*G)+'.::h'D "  $$ 3 (    sD.D;; E#EE#)aIn a peaceful grove beneath a silver moon, a unicorn named Lumina discovered a hidden pool that reflected the stars. As she dipped her horn into the water, the pool began to shimmer, revealing a pathway to a magical realm of endless night skies. Filled with wonder, Lumina whispered a wish for all who dream to find their own hidden magic, and as she glanced back, her hoofprints sparkled like stardust.)NNNNNNNNNNNNNNNNNNNNNNN)NNNNN)NNNrNNN)@rr functoolsrtypingrrrrrr r r httpxrlitellm.constantsr *litellm.litellm_core_utils.litellm_loggingr LiteLLMLoggingObj.litellm.llms.base_llm.responses.transformationr*litellm.llms.custom_httpx.llm_http_handlerr;litellm.responses.litellm_completion_transformation.handlerrlitellm.responses.utilsrlitellm.types.llms.openairrrrrrrrrlitellm.types.responses.mainlitellm.types.routerr litellm.utilsrrstreaming_iteratorr rrrrWintboolfloatTimeoutrrvrDeleteResponseResultrrrrrrrTrXrVrs QQQ -SQI=   +57A+,,R,T) o11l37"&'+%))-*.*.%) !%!#'.2(,+/!8</3,0+/59)-9@ (( )@ @d-. /@3- @  } @ \ " @tCH~&@"$@#3-@ "@ D>@@ TN@%@ * +@ *%!@" HY' (#@$ E?%@&!345'@( 3-)@.DcN+/@0$sCx.)1@2c3h(3@4eE5==01 25@8"#9@< !B BC=@H37"&'+%))-*.*.%) !%!#'.2(,+/!8</3,0+/59)-9g (( )g g d-. /g 3- g  } g \ " g tCH~&g "$g #3-g  "g  D>g g  TNg %g  * +g *%!g " HY' (#g $ E?%g &!345'g ( 3-)g .DcN+/g 0$sCx.)1g 2c3h(3g 4eE5==01 25g 8"#9g < !B BC=g g T37"&'+%))-*.*.%) !%!#'.2(,+/!8</3,0+/59)-9a (( )a a d-. /a 3- a  } a \ " a tCH~&a "$a #3-a  "a  D>a a  TNa %a  * +a *%!a " HY' (#a $ E?%a &!345'a ( 3-)a .DcN+/a 0$sCx.)1a 2c3h(3a 4eE5==01 25a 8"#9a a H /3,0+/59)-= = DcN+ = $sCx.) = c3h( = eE5==01 2= "#= = = @ /3,0+/59)-Z Z DcN+ Z $sCx.) Z c3h( Z eE5==01 2Z "#Z  35I+I!J JKZ Z z /3,0+/59)-K K DcN+ K $sCx.) K c3h( K eE5==01 2K "#K K K \ /3,0+/59)-h h DcN+ h $sCx.) h c3h( h eE5==01 2h "#h  35I+I!J JKh h V  #'$*.259)-: : C=:  SM: d3i :  : = ! : DcN+: eE5==01 2: "#:  : : z  #'$*.259)-P P C=P  SMP d3i P  P = ! P DcN+P eE5==01 2P "#P  43T>* *+P P rX