h:jddlZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZmZddlmZmZddlmZdd lmZdd lmZdd lmZmZmZerdd lmZGd deZ GddeZ!GddZ"GddZ#GddZ$GddZ%dee!fdZ&dee!fdZ'GddeZ(y)N) TYPE_CHECKINGAnyOptionalProtocolType) HTTPException)verbose_proxy_logger) DualCache)CustomGuardraillog_guardrail_information)get_async_httpx_clienthttpxSpecialProvider)UserAPIKeyAuth)*add_guardrail_to_applied_guardrails_header)GuardrailEventHooks)LLMResponseTypes ModelResponseTextCompletionResponse)GuardrailConfigModelceZdZdZy)PangeaGuardrailMissingSecretsz,Custom exception for missing Pangea secrets.N)__name__ __module__ __qualname____doc__r/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/pangea/pangea.pyrrs6rrc4eZdZdeefdZdeedefdZy) _TransformerreturncyNrselfs r get_messagesz_Transformer.get_messages# rprompt_messagescyr#rr%r(s rupdate_original_bodyz!_Transformer.update_original_body&r'rN)rrrlistdictr&rr+rrrr r "s) d4j  DJ 3 rr c:eZdZdZdeefdZdeedefdZy)_TextCompletionRequestc||_yr#bodyr%r2s r__init__z_TextCompletionRequest.__init__+  rr!c(d|jddgS)Nuserpromptrolecontentr1r$s rr&z#_TextCompletionRequest.get_messages.sDIIh,?@AArr(cdt|dk(sJ|dd|jd<|jS)Nrr;r8)lenr2r*s rr+z+_TextCompletionRequest.update_original_body2s7?#q(((-a0; (yyrN rrrr4r,r-r&rr+rrrr/r/*s0Bd4jBDJ3rr/c:eZdZdZdeefdZdeedefdZy)_TextCompletionResponsec||_yr#r1r3s rr4z _TextCompletionResponse.__init__9r5rr!c`g}|jdD]}|jd|dd|S)Nchoices assistanttextr9r2appendr%messageschoices rr&z$_TextCompletionResponse.get_messages<s6ii *F OO[VF^L M+rr(ct|t|jdk(sJt|jd|D] \}}|d|d<|jS)NrDr;rFr>r2zipr%r(rKprompt_messages rr+z,_TextCompletionResponse.update_original_bodyCs]?#s499Y+?'@@@@&)$))I*>&P "FN+I6F6N'QyyrNr?rrrrArA8s.d4jDJ3rrAc:eZdZdZdeefdZdeedefdZy)_ChatCompletionRequestc||_yr#r1r3s rr4z_ChatCompletionRequest.__init__Mr5rr!cg}|jdD]h}|d}|d}t|tr|j||dt|tsB|D]"}|ddk(s |j||dd$j|S)NrJr:r;r9typerF)r2 isinstancestrrHr,)r%rJmessager:r; content_parts rr&z#_ChatCompletionRequest.get_messagesPsyy,G6?Di(G'3'' BC'4($+L#F+v5 ,vBV(WX%, -rr(cd}|jdD]X}|d}t|tr||d|d<|dz }t|ts9|D]}|ddk(s ||d|d<|dz }Zt ||k(sJ|jS)NrrJr;r=rUrF)r2rVrWr,r>)r%r(countrXr;rYs rr+z+_ChatCompletionRequest.update_original_body_syy,Gi(G'3'%4U%;I%F " '4($+L#F+v5/>u/Ei/P V, %, -?#u,,,yyrNr?rrrrRrRLs. d4j DJ3rrRc:eZdZdZdeefdZdeedefdZy)_ChatCompletionResponsec||_yr#r1r3s rr4z _ChatCompletionResponse.__init__rr5rr!crg}|jdD]"}|j|dd|ddd$|S)NrDrXr:r;r9rGrIs rr&z$_ChatCompletionResponse.get_messagesusLii *F OO"9-f5%i0; +rr(ct|t|jdk(sJt|jd|D]\}}|d|dd<|jS)NrDr;rXrMrOs rr+z,_ChatCompletionResponse.update_original_bodysc?#s499Y+?'@@@@&)$))I*>&P "FN+9)+DF9 i ('QyyrNr?rrrr]r]qs. d4j DJ3rr]r!cp|xxdk(rnxdk(rnn t|Sxdk(rnxdk(rnyt|S)Ntext_completionatext_completion completion acompletion)r/rR)r2 call_types r_get_transformer_for_requestrgs9  3 !3 3)$/ / M ) *)$/ /rcf|xtdx\t|Stdx \t|Sy)Nr)rrArr]r1s r_get_transformer_for_responseris8  % # %*40 0& _*40 0 rc eZdZdZ ddedeedeedeedeef fd Zded ed efd Ze d e d e dedefdZ e ded e de fdZed eedfdZxZS) PangeaHandlerz Pangea AI Guardrail handler to interact with the Pangea AI Guard service. This class implements the necessary hooks to call the Pangea AI Guard API for input and output scanning based on the configured recipe. guardrail_namepangea_input_recipepangea_output_recipeapi_keyapi_basec ttj|_|xstj j d|_|js td|xs#tj j dxsd|_ ||_ ||_ |jd|_ t|8d d|i|tj d|d |d |jy ) a Initializes the PangeaHandler. Args: guardrail_name (str): The name of the guardrail instance. pangea_recipe (str): The Pangea recipe key to use for scanning. api_key (Optional[str]): The Pangea API key. Reads from PANGEA_API_KEY env var if None. api_base (Optional[str]): The Pangea API base URL. Reads from PANGEA_API_BASE env var or uses default if None. **kwargs: Additional arguments passed to the CustomGuardrail base class. ) llm_providerPANGEA_API_KEYz_Pangea API Key not found. Set PANGEA_API_KEY environment variable or pass it in litellm_params.PANGEA_API_BASEz$https://ai-guard.aws.us.pangea.cloudz/v1/text/guardrlz#Initialized Pangea Guardrail: name=z , recipe=z , api_base=Nr)r rGuardrailCallback async_handlerosenvirongetrorrprmrnguardrail_endpointsuperr4r info)r%rlrmrnrorpkwargs __class__s rr4zPangeaHandler.__init__s&4-?? B"**..1A"B ||/q   6zz~~/0 65 $7 $8!%)]]O>"B AA&A!!1.1AK^J__jkokxkxjy z rpayload hook_namer!c Kd|jdd} tjd|d|jd||jj |j||d{}|j |j}tjd|d ||jd ijd d urEtjd|d |tdd|j|jd dtjd|d|jd ijd|S7#t$r}|d}~wt$rl}tjd|d|dt|ddxrt|j ddtdd|jt#|d|d}~wwxYww)a Makes the API call to the Pangea AI Guard endpoint. The function itself will raise an error in the case that a response should be blocked, but will return a list of redacted messages that the caller should act on. Args: payload (dict): The request payload. request_data (dict): Original request data (used for logging/headers). hook_name (str): Name of the hook calling this function (for logging). Raises: HTTPException: If the Pangea API returns a 'blocked: true' response. Exception: For other API call failures. Returns: list[dict]: The original response body zBearer zapplication/json) Authorizationz Content-TypezPangea Guardrail (z): Calling endpoint z with payload: )urljsonheadersNz): Received response: resultblockedTz): Request blocked. Response: iz Violated Pangea guardrail policy)errorrlpangea_response status_codedetailz): Request passed. Response: detectorsz): Error calling API: z. Response text: responserFz)Error communicating with Pangea Guardrail)rrl exception)ror debugrzrvpostraise_for_statusrrywarningrrlr| ExceptionrgetattrrrW)r%rrrrres r_call_pangea_guardz PangeaHandler._call_pangea_guards6( 't||n5. 3  & &$YK/CDD[D[C\\klsktu "//44++'75H  % % ']]_F & &$YK/EfXN  zz(B'++I6$>$,,( 3QRXQYZ$ #!C*.*=*=+1::h+?%))( 3PQWQ[Q[\dfhQiQmQmnyQzP{|M9< G  & &$YK/EaSHYZabceoquZv[]|CDEDNDNPVX\|]Z^_   H&*&9&9!$Q  sIGAE)E *C"E G E GE G&A'G  GGuser_api_key_dictcachedatarfc Ktj}|j||dur%tjd|j d|St ||}|s'tjd|j d|dy|j}|s$tjd|j dyd |d }|jr|j|d <|j|d d{} t||j | jdijdg} |j| S7O#t$r*} tdd|j t!| d| d} ~ wwxYww)Nr event_typeT>Pangea Guardrail (async_pre_call_hook): Guardrail is disabled .z;Pangea Guardrail (async_pre_call_hook): Skipping guardrail z9 because we cannot determine type of request: call_type ''z because messages is empty.FrrJrecipeasync_pre_call_hook) request_datarlrr(rz&Failed to update original request bodyrrl exceptionsr)rpre_callshould_run_guardrailr rrlrgrr&rmrrryr+rrrW) r%rrrrfr transformerrJai_guard_payloadai_guard_responser(rs rrz!PangeaHandler.async_pre_call_hooks)11  $ $$: $ Fd R & &PQUQdQdPeefg K24C  ( (MdNaNaMbKI;VWY  ++- ( (MdNaNaMb-.      # #)-)A)A X &"&"9"9 3#   3d.A.A ,//"=AABSUWX 33OD D  E&*&9&9"%a&  s6C+E5-D=.=E5,D?<E5? E2%E--E22E5rc Ktj}|j||dur%tjd|j d|St |}|s$tjd|j dy|j}tjd|d |d }|jr|j|d <|j|d d{}|jd ijdg} |j| S78#t$r*} tdd|j t| d| d} ~ wwxYww)a) Guardrail hook run after a successful LLM call (scans output). Args: data (dict): The original request data. user_api_key_dict (UserAPIKeyAuth): User API key details. response (LLMResponseTypes): The response object from the LLM call. rTrrzDPangea Guardrail (async_post_call_success_hook): Skipping guardrail z, because we cannot determine type of requestNzGOT MESSAGES: Frrpost_call_success_hookrr(rz'Failed to update original response bodyrr)r post_callrr rrlrirr&rnrryr+rrrW) r%rrrrrrJrrr(rs rasync_post_call_success_hookz*PangeaHandler.async_post_call_success_hookZsq )22  $ $$: $ Fd R & &PQUQdQdPeefg K3H=  ( (VW[WjWjVk>?  ++-$$~hZ%@A    $ $)-)B)B X &"&"9"9 6#  ,//"=AABSUWX 33OD D   F&*&9&9"%a&  s6CE D&E DE  E %EE  E rcddlm}|S)NrPangeaGuardrailConfigModel)5litellm.types.proxy.guardrails.guardrail_hooks.pangearrs rget_config_modelzPangeaHandler.get_config_models *)r)NNNN)rrrrrWrr4r-rr rr rrr staticmethodrr __classcell__)r~s@rrkrks .2.2!%"& * * &c]* 'sm * # * 3- * XJJJJX8)88 8  88t66*6 # 66p*ht,B'CD**rrk))rwtypingrrrrrfastapirlitellm._loggingr litellm.caching.dual_cacher %litellm.integrations.custom_guardrailr r &litellm.llms.custom_httpx.http_handlerr rlitellm.proxy._typesr)litellm.proxy.common_utils.callback_utilsrlitellm.types.guardrailsrlitellm.types.utilsrrr3litellm.types.proxy.guardrails.guardrail_hooks.baserrrr r/rArRr]rgrirkrrrrs ??!1009WWX I  8   (""J4Xl5K8L+Az*Oz*r