h2-ddlZddlZddlmZmZddlmZddlmZddlm Z ddl m Z ddl m Z dd lmZGd d e Zy) N)datetime timedelta)Optional)verbose_logger) CustomLogger)CloudZeroStreamer)LiteLLMDatabase)CBFTransformerceZdZdZddeedeedeeffd Zddedeedefd Z ddedeefd Z ddedeefd Z d Z dd Z xZS)CloudZeroLoggeraH CloudZero Logger for exporting LiteLLM usage data to CloudZero AnyCost API. Environment Variables: CLOUDZERO_API_KEY: CloudZero API key for authentication CLOUDZERO_CONNECTION_ID: CloudZero connection ID for data submission CLOUDZERO_TIMEZONE: Timezone for date handling (default: UTC) api_key connection_idtimezonec t|di||xstjd|_|xstjd|_|xstjdd|_y)zXInitialize CloudZero logger with configuration from parameters or environment variables.CLOUDZERO_API_KEYCLOUDZERO_CONNECTION_IDCLOUDZERO_TIMEZONEUTCN)super__init__osgetenvrrr)selfrrrkwargs __class__s d/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/integrations/cloudzero/cloudzero.pyrzCloudZeroLogger.__init__sZ "6"@")),?"@ *Rbii8Q.R JBII.BE$J target_hourlimit operationcnK tjd|jr |js t d|j ||d{}|j rtjdyt|j|j|j}tjdt|d|j||tjd t|dy7#t$r'}tjd t|d}~wwxYww) a Exports the usage data for a specific hour to CloudZero. - Reads spend logs from the DB for the specified hour - Transforms the data to the CloudZero format - Sends the data to CloudZero Args: target_hour: The specific hour to export data for limit: Optional limit on number of records to export (default: 1000) operation: CloudZero operation type ("replace_hourly" or "sum") z,CloudZero Logger: Starting usage data exportzpCloudZero configuration missing. Please set CLOUDZERO_API_KEY and CLOUDZERO_CONNECTION_ID environment variables.Nz/CloudZero Logger: No usage data found to export)rr user_timezonezCloudZero Logger: Transmitting z records to CloudZero)r"z(CloudZero Logger: Successfully exported z.CloudZero Logger: Error exporting usage data: )rdebugrr ValueError_fetch_cbf_data_for_houris_emptyinfor rlen send_batched Exceptionerrorstr)rr r!r"cbf_datastreameres rexport_usage_dataz!CloudZeroLogger.export_usage_data!s   !O P<z>CloudZeroLogger._display_cbf_data_on_screen..sJK3Jc3dK|](}|jds|jdd*yw)rRNrVrXs rr[z>CloudZeroLogger._display_cbf_data_on_screen..+!}^d^h^hi{^|&**-?"D!}00c3dK|](}|jds|jdd*yw)rPr^NrVrXs rr[z>CloudZeroLogger._display_cbf_data_on_screen..r_r`c3@K|]}|jddyw)rMrNrVrXs rr[z>CloudZeroLogger._display_cbf_data_on_screen..sOV6::na8Or\u( [bold blue]📊 CBF Summary[/bold blue]z Records: ,z Total Cost: $z.2fz Total Tokens: z Unique Accounts: z Unique Services: uM [dim]💡 This is the CloudZero CBF format ready for AnyCost ingestion[/dim])rich.boxr? rich.consoler@ rich.tablerAr(printr*to_dicts add_columnr.rWadd_rowsumset)rr/r?r@rAconsolerecords cbf_tablerZtime_usage_start cost_cost usage_amount resource_idresource_serviceresource_accountresource_region total_costunique_accountsunique_services total_tokenss rr<z+CloudZeroLogger._display_cbf_data_on_screens#($)     MMC D  KCPXM?Zpqr##%d&Z`a /vuM[RWX^8WV[\])UK/vuM/wN.eUKF"6::.@%#HI FJJ{A67Ivzz.!<=Lfjj>?K"6::.@%#HI "6::.@%#HI !&**->"FGO       (  i J'JJ c!}SZ!}}~c!}SZ!}}~OwOO  AB CL#345  3'789 (a(89: +O+<=> +O+<=> fgrcKddlm}||dfd}tj|t j dyw)z Initialize a background job that exports usage data every hour. Uses PodLockManager to ensure only one instance runs the export at a time. Args: redis_cache: Redis cache instance for pod locking r)PodLockManager) redis_cachecloudzero_hourly_exportcK tj}|jddd}|tdz }j d{}|rd t j d|j|d{t j d|jd{nt jdtjtdzjddd}|tjz j}tj|d{C777#jd{7wxYw7+#t$rI}t jdt|tjd d{7Yd}~vd}~wwxYww) Nr)minutesecond microsecondr)hoursz3CloudZero Background Job: Starting export for hour z4CloudZero Background Job: Completed export for hour zHCloudZero Background Job: Another instance is already running the exportz7CloudZero Background Job: Error in hourly export task: i,)rutcnowreplacer acquire_lockrr)r2 release_lockr% total_secondsasynciosleepr,r-r.) nowr lock_acquired next_hour sleep_secondsr1 cronjob_id lock_managerrs rhourly_export_taskz?CloudZeroLogger.init_background_job..hourly_export_tasks-"//+C"%++Qqa+"PK"- 0B"BK+7*C*CJ*O$OM$H*//2efqer0st"&"8"8"EEE*//2fgrfs0tu#/";";J"GGG&,,-wx"*!2YQ5G!G P PXYbcqr P sI%.1B%B$Q$Q$SM!-- 6663%P FH,";";J"GGG7 -"((+bcfghcibj)kl!--,,,-sGA E/EE/,EE E"E/6E 7B E/E-E/GE/ E E/E*#E&$E**E// G89F<1F42F<7G<GGz8CloudZero Background Job: Initialized hourly export taskN)6litellm.proxy.db.db_transaction_queue.pod_lock_managerr|r create_taskrr%)rr}r|rrrs` @@rinit_background_jobz#CloudZeroLogger.init_background_jobsF &+> .  -D .01WXsA A)NNN)replace_hourly)r)N)__name__ __module__ __qualname____doc__rr.rrintr2r'r=r<r __classcell__)rs@rr r sK KXc]KemnqerK+8+HSM+eh+Z(8TW=>8HUXM8@hD2Yrr )rrrrtypingrlitellm._loggingr"litellm.integrations.custom_loggerr cz_stream_apir r8r r6r r rrrrs0 (+;,%%oYloYr