hpdZddlZddlZddlZddlZddlmZmZmZm Z m Z m Z ddl m Z erddlmZneZddlZddlmZddlmZddlmZmZGd d eZy) z BETA This is the PubSub logger for GCS PubSub, this sends LiteLLM SpendLogs Payloads to GCS PubSub. Users can use this instead of sending their SpendLogs to their Postgres database. N) TYPE_CHECKINGAnyDictListOptionalUnion)StandardLoggingPayload)SpendLogsPayload)verbose_logger)CustomBatchLogger)get_async_httpx_clienthttpxSpecialProviderceZdZ d deedeedeeffd ZdeeeffdZdZdZ d e e e fdeeee ffd ZxZS) GcsPubSubLogger project_idtopic_idcredentials_pathc ddlm}|ttj|_|xst jd|_|xst jd|_ |xst jd|_ |jr |js tdtj|_t|@d i|d|jitj"|j%g|_y ) a Initialize Google Cloud Pub/Sub publisher Args: project_id (str): Google Cloud project ID topic_id (str): Pub/Sub topic ID credentials_path (str, optional): Path to Google Cloud credentials JSON file r_premium_user_check) llm_providerGCS_PUBSUB_PROJECT_IDGCS_PUBSUB_TOPIC_IDGCS_PATH_SERVICE_ACCOUNTz-Both project_id and topic_id must be provided flush_lockN)litellm.proxy.utilsrr rLoggingCallbackasync_httpx_clientosgetenvrrpath_service_account_json ValueErrorasyncioLockrsuper__init__ create_taskperiodic_flush log_queue)selfrrrkwargsr __class__s c/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/integrations/gcs_pubsub/pub_sub.pyr'zGcsPubSubLogger.__init__ s <"8-==# %J 2I(J DBII.C$D )9* RYY &> &dmmLM M!,,. >6>doo>D//12PRreturnc Kddlm}|j|j|jdd{\}}|j d||j|ddddd \}}d|d d }|S78w) z4Construct authorization headers using Vertex AI authr)vertex_chat_completion vertex_ai) credentialsrcustom_llm_providerNzpub-sub) model auth_headervertex_credentialsvertex_projectvertex_locationgemini_api_keystreamr5api_basezBearer zapplication/json) Authorizationz Content-Type)litellmr2_ensure_access_token_asyncr"r_get_token_and_url)r+r2 _auth_headerr9r7_headerss r.construct_request_headersz)GcsPubSubLogger.construct_request_headersEs2 )CC66 +D    0BB$#==)  +C   Q '{m4. - s2A/A-9A/c@Kddlm}ddlm}| t j d||j dd}tjdur(|||||}|jj|n|jj|t|j|jk\r|jd{yy7#t$r@} t jd t!| d t#j$Yd} ~ yd} ~ wwxYww) a Async Log success events to GCS PubSub Topic - Creates a SpendLogsPayload - Adds to batch queue - Flushes based on CustomBatchLogger settings Raises: Raises a NON Blocking verbose_logger.exception if an error occurs r)get_logging_payloadrz6PubSub: Logging - Enters logging function for model %sstandard_logging_objectNT)r, response_obj start_timeend_timezPubSub Layer Error -  )1litellm.proxy.spend_tracking.spend_tracking_utilsrGrrr debuggetr?gcs_pub_sub_use_v1r*appendlen batch_sizeasync_send_batch Exception exceptionstr traceback format_exc) r+r,rIrJrKrGrstandard_logging_payloadspend_logs_payloades r.async_log_success_eventz'GcsPubSubLogger.async_log_success_eventds  <   H& (.zz2KT'R $))T1%8!!-)% &" %%&89%%&>?4>>"doo5++---6-   $ $'Axr)2F2F2H1IJ    sADB2C C CDC D6DDDDcK |js |jjytjdt |jd|jD]}|j |d{ |jjy7"#t $r@}tjdt|dtjYd}~ad}~wwxYw#|jjwxYww)z8 Sends the batch of messages to Pub/Sub NzPubSub - about to flush z eventszPubSub Error sending batch - rL) r*clearr rNrRpublish_messagerUrVrWrXrY)r+messager\s r.rTz GcsPubSubLogger.async_send_batchs #>> NN "  *3t~~+>*?wG  >>**7333* NN "4   $ $/Axr):N:N:P9QR    NN "s]D  B D AB ;B<B C,D B C))6C$C,$C))C,,DD racK |jd{}t|tr|}ntj|t}ddl}|j |jdjd}dd|igi}d|jd|jd }|jj||| d{}|jd vrAtjd t|j t#d |j tj$d|j |jS7/7#t"$r)} tjd t| Yd} ~ yd} ~ wwxYww)z Publish message to Google Cloud Pub/Sub using REST API Args: message: Message to publish (dict or string) Returns: dict: Published message response N)defaultrzutf-8messagesdataz*https://pubsub.googleapis.com/v1/projects/z/topics/z:publish)urlrDjson)zPub/Sub publish error: %szFailed to publish message: zPub/Sub response: %s)rE isinstancerWrgdumpsbase64 b64encodeencodedecoderrrpost status_coder errortextrUrN) r+rarD message_datarlencoded_message request_bodyrfresponser\s r.r`zGcsPubSubLogger.publish_messages^"  ::<t>OxX\XeXeWffnoC!4499|:H##:5$$%@#hmmBTU"=hmm_ MNN  !7 G==? ";=(   !,\#,.-/EEF. $sCx. !.r/r)__doc__r$rgr rXtypingrrrrrrlitellm.types.utilsr litellm.proxy._typesr r?litellm._loggingr (litellm.integrations.custom_batch_loggerr &litellm.llms.custom_httpx.http_handlerr rrrr/r.rsJ BB65+F w'wr/