hPddlZddlmZmZmZmZmZmZmZm Z m Z ddl Z ddl Z ddl m Z mZmZddlmZddlmZddlmZddlmZmZGdd eZd ed ed d efdZd ed ed d efdZddlmZmZedZded edeedeedeededd eeeffdZded edeedeed eeeff dZ deed efdZ!d6de"defdZ#d eeefd eeeffd!Z$d7d"Z% d7d#eeefd$e&d eeeffd%Z' d8d eeefd&eed eeeffd'Z(d7d(Z)d)Z*d*efd+Z+d,ed e&fd-Z,d.ed eefd/Z-d.ed eefd0Z.d1ededed efd2Z/d3ed1edeedeed e j`f d4Z1d ed efd5Z2y)9N) AnyDictListLiteralOptionalSetTupleUnionget_type_hints)supports_response_schemasupports_system_messagesverbose_logger)DEFAULT_MAX_RECURSE_DEPTH) unpack_defs)BaseLLMException)PartTypeSchemac TeZdZ ddededeeeejfffd Z xZ S) VertexAIError status_codemessageheadersc*t||||y)N)rrr)super__init__)selfrrr __class__s _/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/llms/vertex_ai/common_utils.pyrzVertexAIError.__init__s k7SN) __name__ __module__ __qualname__intstrrr rhttpxHeadersr __classcell__)rs@rrrsF 9= TTT%emm 345 TTrrmodelcustom_llm_provider) vertex_aivertex_ai_betageminireturnc |}|dk(rd}t||}tjj|rd}|S#t$r:}t j djt|d}Yd}~|Sd}~wwxYw)Nr,r+r)r*TzUnable to identify if system message supported. Defaulting to 'False'. Received error message - {} Add it here - https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.jsonF) r litellmVertexGeminiConfig_is_model_gemini_spec_model Exceptionrwarningformatr%)r)r*_custom_llm_providersupports_system_messagees rget_supports_system_messager:s(2 "2 2#. ":-A#   % % A A% H&* # #" ( R Y YA  #( ""(s7; A>/A99A>c2|}|dk(rd}t||}|S)Nr,r+r0)r )r)r*r7_supports_response_schemas rget_supports_response_schemar=1s2/..* 8)=! %$r)rr)chat embeddingbatch_embeddingimage_generationmodestreamvertex_projectvertex_locationvertex_api_version)v1v1beta1c d}d}tjj|}|dk(rd}|dur-d}|dk(rd|d|d |d |d }n>d |d |d|d|d|d |d }n(|dk(rd|d|d |d |}nd |d |d|d|d|d | }|jrd |d |d|d|d|d | }|dur|d z }ny|dk(r8d}d |d|d|d|d | }|jrQd |d |d|d|d|d | }n<|dk(r7d}d |d|d|d|d | }|jrd |d |d|d|d|d | }|r|st d|||fS)N)r)r>generateContentTstreamGenerateContentglobalz"https://aiplatform.googleapis.com/ /projects/z+/locations/global/publishers/google/models/:z?alt=ssezhttps://z-aiplatform.googleapis.com/ /locations/z/publishers/google/models/z /endpoints/r?predictz'-aiplatform.googleapis.com/v1/projects/rAz,Unable to get vertex url/endpoint for mode: )r1r2get_model_for_vertex_ai_urlisdigit ValueError)rBr)rCrDrErFurlendpoints r_get_vertex_urlrVFsC"H  & & B B B OE v~$ T>.H(*:;M:NjYgXhiTUZT[[\]e\ffno  11LM_L``jkyjz{FGVFWWqrwqxxyzByCCKL(*:;M:NjYgXhiTUZT[[\]e\fg  11LM_L``jkyjz{FGVFWWqrwqxxyzByCD ==?_--HI[H\\fgufvwBCRBSS^_d^eefgofpqC~z!  ))PQ_P``kl{k|}WX]W^^_`h_ij ==?_--HI[H\\fgufvwBCRBSS^_d^eefgofpqC # #))PQ_P``kl{k|}WX]W^^_`h_ij ==?_--HI[H\\fgufvwBCRBSS^_d^eefgofpqC hGvNOO =rgemini_api_keyc:dj|}|dk(r6d}|durd}dj|||}||fSdj|||}||fS|dk(rd }dj|||}||fS|d k(rd }dj|||}||fS|d k(r td fS)Nz models/{}r>rJTrKzEhttps://generativelanguage.googleapis.com/v1beta/{}:{}?key={}&alt=ssez=https://generativelanguage.googleapis.com/v1beta/{}:{}?key={}r? embedContentr@batchEmbedContentsrAzLiteLLM's `gemini/` route does not support image generation yet. Let us know if you need this feature by opening an issue at https://github.com/BerriAI/litellm/issues)r6rS)rBr)rCrW_gemini_model_namerUrTs r_get_gemini_urlr\ys %++E2 v~$ T>.HY``"HnC0 ='PVV&. ( =  !MTT .  = " "'MTT .  = # # u   =rpartscJd}|D]}d|vs|jdsd}|S)a  check that user_content has 'text' parameter. - Known Vertex Error: Unable to submit request because it must have a text parameter. - 'text' param needs to be len > 0 - Relevant Issue: https://github.com/BerriAI/litellm/issues/5515 FtextT)get)r]has_text_paramparts r_check_text_in_contentrcs2N T>dhhv.!N r parametersadd_property_orderingcJtttj}|j di}|j D]\}}t ||t ||t|t|t|t||}|r t||S)a This is a modified version of https://github.com/google-gemini/generative-ai-python/blob/8f77cc6ac99937cd3a81299ecf79608b91b06bbb/google/generativeai/types/content_types.py#L419 Updates the input parameters, removing extraneous fields, adjusting types, unwinding $defs, and adding propertyOrdering if specified, returning the updated parameters. Parameters: parameters: dict - the json schema to build from add_property_ordering: bool - whether to add propertyOrdering to the schema. This is only applicable to schemas for structured outputs. See set_schema_property_ordering for more details. Returns: parameters: dict - the input parameters, modified in place z$defs) setr rkeyspopitemsrconvert_anyof_null_to_nullable process_itemsadd_object_typefilter_schema_fieldsset_schema_property_ordering)rdrevalid_schema_fieldsdefsnamevalues r_build_vertex_schemartsnV499;< >>'2 &Dzz| eE4 $ D! #:.*J&j2EFJ$Z0 r schema_dictc|jdd}|jdd}t|trX|jdrG|d}|s|r {"anyOf": [{"type": "string"}, {"type": "null"}]} Case 2: If additional metadata is present, try to keep it E.g. {"anyOf": [{"type": "string"}, {"type": "null"}], "default": "test", "title": "test"} -> {"anyOf": [{"type": "string", "title": "test"}, {"type": "null", "title": "test"}]} titleN descriptionanyOfc3<K|]}t|tywr ) isinstancedict).0items r z'_filter_anyof_fields..s>tJtT*>s)r`r{r|listall)rurwrxany_ofr~s r_filter_anyof_fieldsrs OOGT *E//-6K+t$)AW% k64(>v>>$)DM*5D'  V$ $  rcd|tkDrtdtdt|trd|vr|dik(rddi|d<|j D]]\}}t|trt ||dz&t|t s7|D]"}t|tst ||dz$_yy)N Max depth of Q exceeded while processing schema. Please check the schema for excessive nesting.rjtypeobject)rrSr{r|rjrlr)schemadepthkeyrsr~s rrlrls ((567H I  &$ f B!6%x0F7O ,,.JC%&eUQY/E4(!D!$-%dEAI6" ) rrrcR|tkDrtdtdd|vrjt|dtrWd|vr)|dj Dcgc]\}}| c}}|d<|dj D]\}}t ||dzd|vrt |d|dz|Scc}}w)ay vertex ai and generativeai apis order output of fields alphabetically, unless you specify the order. python dicts retain order, so we just use that. Note that this field only applies to structured outputs, and not tools. Function tools are not afflicted by the same alphabetical ordering issue, (the order of keys returned seems to be arbitrary, up to the model) https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.cachedContents#Schema.FIELDS.property_ordering Args: schema: The schema dictionary to process depth: Current recursion depth to prevent infinite loops rr propertiespropertyOrderingrrj)rrSr{r|rjro)rrkvs rroros ((567H I  v*VL-A4"H V +8>|8L8R8R8T)U1!)UF% &<(..0DAq (EAI 61&$VG_eai@ M *Vs B# valid_fieldsc ^| t}t|}||vr|S|j|t|ts|Si}t |}|j D]\}}||vr |dk(rCt|tr3|j Dcic]\}}|t|||c}}||<S|dk(r |dvr|||<bc|dk(r!t|trt|||||<|dk(r/t|tr|D cgc]} t| ||c} ||<|||<|Scc}}wcc} w)zK Recursively filter a schema dictionary to keep only valid fields. rr6> date-timeenumrjry) rgidaddr{r|rrjrnr) rur processed schema_idresultrrsrrr~s rrnrn%sN E ;II MM) k4 ( F&{3K!'') U l "  , :eT#:"KKMAq'<CCF3KH_--#s  G^ 5$ 7.ulINF3K G^ 5$ 7PUHL$T<CF3K F3K+*. M%s D$D*cL|tkDrtdtd |jdd}|d}|D]6}|ddik(r|j|d}d|vs#t |dk(s2d |d<8t |dk(r td |r:|D]5}|jdd k(rd |vr|d s|j d d|d <7|jdd}|(|j D]\}}t||dz|jd d}|t||dzyy)NrrryFrnullTrrzaInvalid input: AnyOf schema with only null type is not supported. Please provide a non-null type.arrayrjnullablerr)r)rrSr`removelenrirjrk) rranyof contains_nullatyperrrrsrjs rrkrkSs_ ((567H I  m JJw %E  E(( U# $ u$Uq (f  u:?2  IIf%05(!'NIIg&$(j!L$/J%++-KD% *5 B. JJw %E &uEAI>rc|jdd}|Cd|vr|d|jddd|d<|jD]\}}t||jdd}| t|yy)Nrrequiredrrrj)r`rirjrm)rrrrrsrjs rrmrmsL$/J  F:$6$> JJz4 (!v%++-KD% E ". JJw %E r field_namec|j|d|jdd}|$|jD]\}}t|||jdd}| t||yy)Nrrj)rir`rj strip_field)rrrrrrsrjs rrrsn JJz4 L$/J%++-KD% z *. JJw %E E:&rvertex_datetimecdddlm}|j|d}t|jS)z Converts a Vertex AI datetime string to an OpenAI datetime integer vertex_datetime: str = "2024-12-04T21:53:12.120184Z" returns: int = 1722729192 r)datetimez%Y-%m-%dT%H:%M:%S.%fZ)rstrptimer$ timestamp)rrdts r+_convert_vertex_datetime_to_openai_datetimers-"   ?,C DB r||~ rrTcXtjd|}|r|jdSdS)z Get the vertex project id from the url `https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/google/models/${MODEL_ID}:streamGenerateContent` z/projects/([^/]+)rNresearchgrouprTmatchs rget_vertex_project_id_from_urlrs* II*C 0E"5;;q>,,rcXtjd|}|r|jdSdS)z Get the vertex location from the url `https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/google/models/${MODEL_ID}:streamGenerateContent` z/locations/([^/]+)rNrrs rget_vertex_location_from_urlrs* II+S 1E"5;;q>,,rrequested_routecBtjdd|d|d|}|S)zS Replace project and location values in the route with the provided values z /projects/[^/]+/locations/[^/]+/rMrO/)rsub)rrDrEmodified_routes r%replace_project_and_location_in_routers4VV+ ^$K/@BN rbase_urlctj|}d|vr#|r|r t|||}|j|S d}d|vrd}dj |||}d|z|z}|j|}|S)a< Allow user to specify their own project id / location. If missing, use defaults Handle cachedContent scenario - https://github.com/BerriAI/litellm/issues/5460 Constructed Url: POST https://LOCATION-aiplatform.googleapis.com/{version}/projects/PROJECT_ID/locations/LOCATION/cachedContents locations)pathrG cachedContentrHz{}/projects/{}/locations/{}r)r&URLr copy_withr6) rrrErD new_base_urlvertex_versionbase_requested_routeupdated_requested_route updated_urls rconstruct_target_urlrs"99X&Lo% oCO%%?%;; 04N/)"8??"$88?J((.E(FK rc0ddlm}||d}|yd|vS)z Check if a model is only available in the global region. Args: model: The model name to check Returns: True if the model is only available in global region, False otherwise r)get_supported_regionsr+r0FrL) litellm.utilsr)r)rsupported_regionss ris_global_only_vertex_modelrs.4-  ( ((r)F)rr )3rtypingrrrrrrr r r r&r1r r rlitellm.constantsr8litellm.litellm_core_utils.prompt_templates.common_utilsr)litellm.llms.base_llm.chat.transformationrlitellm.types.llms.vertex_airrrr%boolr:r=all_gemini_url_modesrVr\rcr|rtrrlr$rornrkrmrrrrrrrrrrrs XXX VV7PF9T$T# #%,-T%U# #2 %  %%,-T%U %  %%> 0 0 0 TN0SM 0 c] 0  0 0 38_0f# # # TN#SM #  38_ #L $x. T 'T'$'Td38nc3h>7$*+ cN#& #s(^<DH+c3h+/23x+ #s(^+\,?^  'C '   -- --c-hsm-  *- @C  )))c])SM )  YY )X)s)t)r