hPddlmZmZmZddlZddlZddlmZddlm Z m Z ddl m Z ddl mZddlmZmZdd lmZd ZGd d eZy) )ListOptionalTupleN)verbose_logger)filter_value_from_dictstrip_name_from_messages)get_secret_str)AllMessageValues)Choices ModelResponse)OpenAIGPTConfigzhttps://api.x.ai/v1cJeZdZedeefdZdeedeedeeeeeffdZdede fdZ dede fdZ dd e d e ded e de f d Zded eed e de de de f fd ZededdfdZ ddedej,dede d eed e de deedee deffd ZxZS) XAIChatConfigreturncy)Nxai)selfs `/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/llms/xai/chat/transformation.pycustom_llm_providerz!XAIChatConfig.custom_llm_providersapi_baseapi_keycV|xstdxst}|xs td}||fS)N XAI_API_BASE XAI_API_KEY)r r)rrrdynamic_api_keys r$_get_openai_compatible_provider_infoz2XAIChatConfig._get_openai_compatible_provider_infos2M~n=M!B^M%B((rmodelcgd}|j|r|jd tj||jr|jd|S#t $r#}t jd|Yd}~|Sd}~wwxYw)N)frequency_penalty logit_biaslogprobs max_tokensnpresence_penaltyresponse_formatseedstreamstream_options temperature tool_choicetools top_logprobstop_puserweb_search_optionsstop)r rreasoning_effortz,Error checking if model supports reasoning: )_supports_stop_reasonappendlitellmsupports_reasoningr Exceptionrdebug)rr base_openai_paramses rget_supported_openai_paramsz)XAIChatConfig.get_supported_openai_params s (  % %e ,  % %f - U))1I1I#))*<="! U  #OPQs!S T T!! Us2A B%BBcd|vryd|vryy)Nz grok-3-miniFzgrok-4Tr)rr s rr5z#XAIChatConfig._supports_stop_reasonAs E !  rnon_default_paramsoptional_params drop_paramsc|j|}|jD]b\}}|dk(r||d<|dk(r@|>g}|D]"} t| d} | |j| $t |dkDsP||d<V||vs[|^|||<d|S)N)r max_completion_tokensr%r.strictr)r=itemsrr6len) rr?r@r rAsupported_openai_paramsparamvaluer.tools rmap_openai_paramszXAIChatConfig.map_openai_paramsHs#'"B"B"B"O.446LE5//05 -'!e&7!D1$AD' T*"u:>/4OG,11$-2OE*7rmessageslitellm_paramsheadersc@t|}t| |||||S)zp Handle https://github.com/BerriAI/litellm/issues/9720 Filter out 'name' from messages )rsupertransform_request)rr rLr@rMrN __class__s rrQzXAIChatConfig.transform_request`s,,H5w( 8_ng  rchoiceNc|jdk(rB|jjr+t|jjdkDrd|_yyyy)z Helper to fix finish_reason for tool calls when XAI API returns empty string. XAI API returns empty string for finish_reason when using tools, so we need to set it to "tool_calls" when tool_calls are present. r tool_callsN) finish_reasonmessagerVrF)rSs r(_fix_choice_finish_reason_for_tool_callsz6XAIChatConfig._fix_choice_finish_reason_for_tool_callsrsM  B & NN % % )) *Q .#/F  / & 'r raw_responsemodel_response request_data json_modec t|||||||||| | |  } | jr3| jD]$} t| ts|j | &| S)z Transform the response from the XAI API. XAI API returns empty string for finish_reason when using tools, so we need to fix this after the standard OpenAI transformation. ) r rZr[ logging_objr\rLr@rMencodingrr])rPtransform_responsechoices isinstancer rY)rr rZr[r_r\rLr@rMr`rr]responserSrRs rraz XAIChatConfig.transform_responsest,7-%)#%+).     "**fg.AA&I+r)F)NN)__name__ __module__ __qualname__propertyrstrrrrlistr=boolr5dictrKrr rQ staticmethodr rYhttpxResponser ra __classcell__)rRs@rrrs Xc])  )08 ) x}hsm+ ,)"""B34"       0  '(         $ 0 0T 0 0."&$(**nn*& *  *'(***#*D>* **rr)typingrrrrnr7litellm._loggingr8litellm.litellm_core_utils.prompt_templates.common_utilsrrlitellm.secret_managers.mainr litellm.types.llms.openair litellm.types.utilsr r openai.chat.gpt_transformationrrrrrrrxs:(( +866=$ UOUr