h{ndZddlmZmZmZmZddlmZmZddl m Z ddl m Z erddl mZGdd e Zy ) zQ Translate from OpenAI's `/v1/chat/completions` to VLLM's `/v1/chat/completions` ) TYPE_CHECKINGListOptionalTuple)get_secret_boolget_secret_str)LiteLLM_Params)OpenAIGPTConfig)AllMessageValuesceZdZdedeffd Zdededededef dZde ed e ede e ee effd Z dd e ede edeeffd Z e dd e ede efd Ze dd e efdZe ddede ed e ede eee ee effdZdededded ededef dZdededded ededef dZxZS)LiteLLMProxyChatConfigmodelreturncjt||}|jd|jd|S)Nthinkingreasoning_effort)superget_supported_openai_paramsappend)selfr params_list __class__s j/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/llms/litellm_proxy/chat/transformation.pyrz2LiteLLMProxyChatConfig.get_supported_openai_paramss5g9%@ :&-.non_default_paramsoptional_params drop_paramsc|j|}|jD]*\}}|dk(r||jdid<!||vs&|||<,|S)Nr extra_body)ritems setdefault)rrrrrsupported_openai_paramsparamvalues r_map_openai_paramsz)LiteLLMProxyChatConfig._map_openai_paramssf#'"B"B5"I.446LE5 "KP**<>$F  $ $ ,rcddl}d}|jdr|jddd}|jj ||\}}||||fS)a Force use litellm proxy for all models Issue: https://github.com/BerriAI/litellm/issues/10559 Expected behavior: - custom_llm_provider will be 'litellm_proxy' - api_base = api_base OR LITELLM_PROXY_API_BASE - api_key = api_key OR LITELLM_PROXY_API_KEY Use case: - When using Google ADK, users want a flag to dynamically enable sending the request to litellm proxy or not - Allow the model name to be passed in original format and still use litellm proxy: "gemini/gemini-1.5-pro", "openai/gpt-4", "mistral/llama-2-70b-chat" etc. Return model, custom_llm_provider, dynamic_api_key, api_base rN litellm_proxyr0/)r'r()r9 startswithsplitrr.)rr'r(r9custom_llm_providers r*litellm_proxy_get_custom_llm_provider_infozALiteLLMProxyChatConfig.litellm_proxy_get_custom_llm_provider_infoTsr* -   , -KKQ'*E  * * , Q Qw R    )7H<} >7?} > c >BXc]BhsmBB37 0.MQ!=!=&sm!==Ec]!= sC# 5 6!=!=F    )*               )*           rrN)__doc__typingrrrrlitellm.secret_managers.mainrrlitellm.types.routerr openai.chat.gpt_transformationr litellm.types.llms.openair rrHrrr[s/87H/=:D _D r