hIddlZddlmZmZmZmZmZmZmZm Z ddl m Z ddl m Z ddlmZddlmZmZddlmZddlmZmZdd lmZdd lmZdd lmZdd lmZdd l m!Z"erddl#m$Z$Gdde%Z&Gdde%Z'GddeZ(y)N) TYPE_CHECKINGAnyDictLiteralOptionalTupleTypeUnion) HTTPException) DualCache)verbose_proxy_logger)CustomGuardraillog_guardrail_information)get_llm_provider)get_async_httpx_clienthttpxSpecialProvider)UserAPIKeyAuth)*add_guardrail_to_applied_guardrails_header)GuardrailEventHooks)LLMResponseTypes)version)GuardrailConfigModelceZdZdZy)PillarGuardrailMissingSecretsz0Exception raised when Pillar API key is missing.N__name__ __module__ __qualname____doc__r/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/pillar/pillar.pyrr)s:r!rceZdZdZy)PillarGuardrailAPIErrorz>Exception raised when there's an error calling the Pillar API.Nrr r!r"r$r$/sHr!r$ceZdZdZddgZdZdZ d#deedeedeed eed df fd Z e d e d e de dedd eeeee ff dZe de d e dedd eeeee ffdZe de d e ded efdZde d e fdZd eeeffdZde d eeeffdZde d eeeffdZdeeefdeeefd eeeffdZdeeefde d dfdZdeeefd dfd Zed ee d!fd"Z!xZ"S)$PillarGuardrailz Pillar Security Guardrail for LiteLLM. Provides comprehensive AI security scanning for input prompts and output responses using the Pillar Security API. blockmonitorzhttps://api.pillar.securityNguardrail_nameapi_keyapi_baseon_flagged_actionreturnc ttj|_|xstj j d|_|j d}t||xs#t jdxs |j|_ |xstj j d}|r||jvr||_ n,|rtjd|d|j |_ tj"d |jt$j&t$j(t$j*g}t- |\d ||d |y) ai Initialize the Pillar guardrail. Args: guardrail_name: Name of the guardrail instance api_key: Pillar API key api_base: Pillar API base URL on_flagged_action: Action to take when content is flagged ('block' or 'monitor') **kwargs: Additional arguments passed to parent class ) llm_providerPILLAR_API_KEYNCouldn't get Pillar API key, either set the `PILLAR_API_KEY` in the environment or pass it as a parameter to the guardrail in the config filePILLAR_API_BASEPILLAR_ON_FLAGGED_ACTIONzInvalid action 'z', using defaultz6Pillar Guardrail: Initialized with on_flagged_action: )r)supported_event_hooksr )rrGuardrailCallback async_handlerosenvirongetr*rgetenv BASE_API_URLr+SUPPORTED_ON_FLAGGED_ACTIONSr,r warningDEFAULT_ON_FLAGGED_ACTIONdebugrpre_call during_call post_callsuper__init__) selfr)r*r+r,kwargsmsgactionr4 __class__s r"rDzPillarGuardrail.__init__BsB$4-?? B"**..1A"B << M 04 4 UBII.?$@UDDUDU #Pbjjnn5O&P f A AA%+D "$,,&vh.>?&*%C%CD """DTE[E[D\ ] ( (  + +  ) )!   )"7  r!user_api_key_dictcachedata call_type) completiontext_completion embeddingsimage_generation moderationaudio_transcriptionpass_through_endpointrerankc.Ktj}|j||dur$tjd|j |Stjd|j |d{}t||j |S7w)a Pre-call hook to scan the request for security threats before sending to LLM. Args: user_api_key_dict: User API key authentication info cache: LiteLLM cache instance data: Request data call_type: Type of LLM call Returns: Original data if safe, raises HTTPException if blocked Raises: HTTPException: If request should be blocked due to security threats rL event_typeTz1Pillar Guardrail: Pre-call scanning disabled for zPillar Guardrail: Pre-call hookN request_datar))rr@should_run_guardrailr r?r)run_pillar_guardrailr)rErJrKrLrMrXresults r"async_pre_call_hookz#PillarGuardrail.async_pre_call_hooks@)11  $ $$: $ Fd R & &CDDWDWCXY K""#DE0066 3d.A.A  7A3B5B6B)rNrPrQrRrS responsesc.Ktj}|j||dur$tjd|j |Stjd|j |d{}t||j |S7w)a During-call hook to scan the request in parallel with LLM processing. Args: data: Request data user_api_key_dict: User API key authentication info call_type: Type of LLM call Returns: Original data if safe, raises HTTPException if blocked Raises: HTTPException: If request should be blocked due to security threats rWTz4Pillar Guardrail: During-call scanning disabled for z-Pillar Guardrail: During-call moderation hookNrY)rrAr[r r?r)r\r)rErLrJrMrXr]s r"async_moderation_hookz%PillarGuardrail.async_moderation_hooks8)44  $ $$: $ Fd R & &FtGZGZF[\ K""#RS0066 3d.A.A  7r_responsectKtj}|j||dur$tjd|j |Stjdt |dr|jni}|jdgDcgc]$}|jdr|jd&}}|stjd|S|j}|jd g|z|d <|j|d {t||j |Scc}w7"w) a Post-call hook to scan LLM responses before returning to user. Args: data: Original request data user_api_key_dict: User API key authentication info response: LLM response to scan Returns: Original response if safe, raises HTTPException if blocked Raises: HTTPException: If response should be blocked due to security threats rWTz2Pillar Guardrail: Post-call scanning disabled for z Pillar Guardrail: Post-call hook model_dumpchoicesmessagezJPillar Guardrail: No response content to scan, skipping post-call analysismessagesNrY) rrBr[r r?r)hasattrrer9copyr\r) rErLrJrcrX response_dictchoiceresponse_messagespost_call_datas r"async_post_call_success_hookz,PillarGuardrail.async_post_call_success_hooks?*)22  $ $$: $ Fd R & &DTEXEXDYZ O""#EF29<1P++-VX (++Ir: zz)$ JJy !  ! & &\ O%)XXj"%=@Q%Qz"''777 3d.A.A 1 " 8sBD8)D1#A<$A>;C<A>> CA CCCcp|js d}t|d|jdd}d|d<d|d<|S)z+Prepare headers for the Pillar API request.r1zBearer zapplication/json) Authorizationz Content-Typetrue plr_evidence plr_scanners)r*r)rErGrqs r"rsz PillarGuardrail._prepare_headersNsV||M 04 4 't||n5.#  #)"(r!c@|jd}|sy t||jd|jd|jd\}}}}|xsd|xsdfS#t$r1|xsd|jdxs|jdxsdfcYSwxYw) z Extract the model and provider from the request data. Args: data: Request data Returns: Tuple of (model_name, provider_name) model)unknownrcustom_llm_providerr+r*)rrr+r*rprovider)r9rrw)rErLr clean_modelr_s r"_extract_model_and_providerz+PillarGuardrail._extract_model_and_providerbs!' *:$(HH-B$C*-+ + 'K1a +)X-BB B "./T488J3GT9  sA A##7BBc j|jdg}|jdg}dtd}|||d}|jd}|r||d<|jdijd }|r||d <|j|\}} ||d <| |d <tjd |d|d|d| |S)z Prepare the payload for the Pillar API request following the /api/v1/protect contract. Args: data: Request data Returns: Formatted payload for Pillar API rhtoolslitellm)sourcer)rhrmetadatauseruser_idrpillar_session_id session_idrrz)Pillar Guardrail: Request context - user= , session=z, model=z , provider=)r9litellm_versionrr r?) rErLrhrrrrrrrrs r"rtz PillarGuardrail._prepare_payloads88J+"%& !  ((6" !(GI XXj"-112EF $.GL !::4@x & ""7y :,WG;xj 2 r!rqrrc Ktjdt|jdgd|jj |j d||dd{}|j|j}|jd}|jd }tjd |d ||S7cw) z Call the Pillar API and return the response. Args: headers: HTTP headers for the request payload: Request payload Returns: Pillar API response as dictionary zPillar Guardrail: Scanning rhz messages for security threatsz/api/v1/protectg>@)urlrqjsontimeoutNflaggedrz.Pillar Guardrail: Analysis complete - flagged=r) r r?lenr9r6postr+raise_for_statusr)rErqrrrcresrrs r"ruz PillarGuardrail._call_pillar_apis "")#gkk*b.I*J)KKi j ++00==/1 1   !!#mmo'')$WW\* ""  ( ()L M%%066G''94$))]5 r!cdd|jd|jdi|jdgdd}tjdtd | ) a Raise an HTTPException for Pillar security detections. Args: pillar_response: Response from Pillar API containing detection details Raises: HTTPException: Always raises with security detection details z$Blocked by Pillar Security GuardrailzSecurity threats detectedrscannersevidence)rrr)rydetection_messagerz=Pillar Guardrail: Request blocked - Security threats detectedi) status_codedetail)r9r r=r )rEr error_details r"rz1PillarGuardrail._raise_pillar_detection_exceptionsfr;rrzrDrrr dictrr rwr^rbrror\rrsrrrrtrurvr staticmethodr r __classcell__)rIs@r"r&r&6sg%,Y#7 )0L):!%"&+/ :   : #: 3- : $C= :  : @.).. .    . % 3,- ...`****  * % 3,- .**X77*7# 7  77z*t**`$sCx.(sCx<+T+d38n+ZCH~04S#X c3h@%#CH~%>B% %NB#CH~B B@ *ht,B'CD * *r!r&))r7typingrrrrrrr r fastapir rr litellm._loggingr %litellm.integrations.custom_guardrailrr1litellm.litellm_core_utils.get_llm_provider_logicr&litellm.llms.custom_httpx.http_handlerrrlitellm.proxy._typesr)litellm.proxy.common_utils.callback_utilsrlitellm.types.guardrailsrlitellm.types.utilsrlitellm._versionrr3litellm.types.proxy.guardrails.guardrail_hooks.baserrwrr$r&r r!r"rss RRR"1O0907X I  i j*oj*r!