h1ddlmZmZmZmZmZddlmZmZddl Z ddl m Z ddl m Z ddlmZmZddlmZdd lmZdd lmZd d lmZd dlmZer ddlmZeZneZGddeZy)) TYPE_CHECKINGAnyListOptionalUnion)HeadersResponseN convert_to_azure_openai_messages)BaseLLMException)+API_VERSION_MONTH_SUPPORTED_RESPONSE_FORMAT*API_VERSION_YEAR_SUPPORTED_RESPONSE_FORMAT) ModelResponse)UnsupportedParamsError)AllMessageValues) BaseConfigAzureOpenAIError)Loggingc<eZdZdZ d0deedeeeefdee deedeedeed eed eeee fd eed eed dfdZ e fdZ ded e efdZded efdZdeded efdZ d1dededededed ef dZdede edededed ef dZ d2deded ed!ed"ede ededed#ed$eed%eed efd&Zd efd'Zdedefd(Zd e efd)Zd e efd*Zd+ed,edeeefd efd-Z d2dedede ededed$eed.eed efd/Z!xZ"S)3AzureOpenAIConfigaR Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions The class `AzureOpenAIConfig` provides configuration for the OpenAI's Chat API interface, for use with Azure. Below are the parameters:: - `frequency_penalty` (number or null): Defaults to 0. Allows a value between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, thereby minimizing repetition. - `function_call` (string or object): This optional parameter controls how the model calls functions. - `functions` (array): An optional parameter. It is a list of functions for which the model may generate JSON inputs. - `logit_bias` (map): This optional parameter modifies the likelihood of specified tokens appearing in the completion. - `max_tokens` (integer or null): This optional parameter helps to set the maximum number of tokens to generate in the chat completion. - `n` (integer or null): This optional parameter helps to set how many chat completion choices to generate for each input message. - `presence_penalty` (number or null): Defaults to 0. It penalizes new tokens based on if they appear in the text so far, hence increasing the model's likelihood to talk about new topics. - `stop` (string / array / null): Specifies up to 4 sequences where the API will stop generating further tokens. - `temperature` (number or null): Defines the sampling temperature to use, varying between 0 and 2. - `top_p` (number or null): An alternative to sampling with temperature, used for nucleus sampling. Nfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_preturnc tj} | jD]%\} } | dk7s | t|j| | 'y)Nself)localscopyitemssetattr __class__)r'rrrrrr r!r"r#r$locals_keyvalues f/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/llms/azure/chat/gpt_transformation.py__init__zAzureOpenAIConfig.__init__8sA(--/!--/JCf}!2U3*c t|S)N)super get_config)clsr,s r0r5zAzureOpenAIConfig.get_configJsw!##r2modelc gdS)N)r#r streamstream_optionsr"rmax_completion_tokenstools tool_choicer!rruserrrr<r=r$logprobs top_logprobsresponse_formatseed extra_headersparallel_tool_calls prediction modalitiesaudioweb_search_options)r'r7s r0get_supported_openai_paramsz-AzureOpenAIConfig.get_supported_openai_paramsNs   r2cDddl}|jdd|}d|vsd|vryy) aj Determines if the model supports response_format. - Handles Azure deployment names (e.g., azure/gpt-4.1-suffix) - Normalizes model names (e.g., gpt-4-1 -> gpt-4.1) - Strips deployment-specific suffixes - Passes provider to supports_response_schema - Backwards compatible with previous model name patterns rNz (\d)-(\d)z\1.\2zgpt-3.5zgpt-35FT)resub)r'r7rLnormalized_models r0#_is_response_format_supported_modelz5AzureOpenAIConfig._is_response_format_supported_modelns2 66,%@ ( (H,=r2api_version_yearapi_version_monthct|}t|}tt}tt}||kDry||kry||k\S)z - check if api_version is supported for response_format - returns True if the API version is equal to or newer than the supported version TF)intrr )r'rPrQapi_year api_monthsupported_yearsupported_months r0)_is_response_format_supported_api_versionz;AzureOpenAIConfig._is_response_format_supported_api_versionsU'()* GHIJ n $  &/ /r2non_default_paramsoptional_params drop_params api_versionc |j|}|jd}|d}|d} |d} |jD]4\} } | dk(r |dks|dk(r| dks|dk(r4| dk(r/| dkr*tjd us||d urDt d d |d  | dk(r:|dk(r5| dkr0tjd us||d ur}t d d| d| d|d | |d<| dk(rNt | tr>|j|} |j|| }|xr| }|j|| |}| dk(r8t | tr(|jdg|dj| *| |vs0| || <7|S)N-rrr=20231201Tiz6Azure does not support 'tool_choice', for api_version=z. Bump your API version to '2023-12-01-preview' or later. This parameter requires 'api_version="2023-12-01-preview"' or later. Azure API Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions) status_codemessagerequired202405zAzure does not support 'z' as a z param, for api_version=a. To drop 'tool_choice=required' for calls with this Azure API version, set `litellm.drop_params=True` or for proxy: `litellm_settings: drop_params: true` Azure API Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completionsrA)rZr/is_response_format_supportedr<)rJsplitr*litellmr[r isinstancedictrOrX_add_response_format_to_toolslist setdefaultextend)r'rYrZr7r[r\supported_openai_paramsapi_version_timesrPrQapi_version_dayparamr/rO(is_response_format_supported_api_versionrhs r0map_openai_paramsz#AzureOpenAIConfig.map_openai_paramss#'"B"B5"I'--c2,Q/-a0+A..446LE5 %%v-(F27H47O(F2-5+d2**d2#/K44G4(+(^_j^klU%Xj($.3D3L**d2#/K44G4(+&>ugWUGSklwkxyD%E 6;OM2++ 5$0G< 4 TN 4 SM 4 C=4#3-4uS$Y'(4c]4}4 4$$$  c @&0 #08;0 08 P PP P  P  P Pd    '(           4"&$(   &  "    '(    # D>   $++$QU CS C  S  "   /2 =B4==Q  "&"&      '(      #  3-     r2r) typingrrrrr httpx._modelsrr rj3litellm.litellm_core_utils.prompt_templates.factoryr )litellm.llms.base_llm.chat.transformationr litellm.types.llms.azurer rlitellm.types.utilsr exceptionsrtypes.llms.openairbase_llm.chat.transformationr common_utilsr*litellm.litellm_core_utils.litellm_loggingrLiteLLMLoggingObjrrrIr2r0rsP<<+G.126+W$LL` ` r2