h ddlZddlZddlmZmZmZddlmZddlmZm Z m Z m Z m Z m Z ddlZddlmZmZmZmZddlZddlmZddlddlmZmZdd lmZdd lmZdd lmZerdd lm Z ne Z eZ!e!jEd dgeegddZ#e!jEddgeegdejHddfde e%fdZ&e!jEddgeegdde e'iiejHddejHddfde e%de e%fdZ(d e)dedefd!Z*e!jEd"dgeegdde e'iid#ejHdd$ejHdd%eefde e%de e%d e)fd&Z+d e)dedefd'Z,e!jEd(dgeegdde e'iid#ejHdd$ejHdd%eefde e%de e%d e)fd)Z-e!jEd*dgeegdde e'iid#ejHd+,ejHdd$ejHdd%fd-e%de e%de e%fd.Z.e!jEd/dgeegdde e'iid#ejHd+,ejHdd$ejHdd%fd-e%de e%de e%fd0Z/e!jEd1dgeegddde e'ii2ejHdd$ejHdd%eefde e%de e%d e)fd3Z0e!jEd4dgeegdde e'iiejHdd$ejHdd%ejHd5d6ejHdd7ejHdd8ejHdd9ejHdd:fde e%de e%d;e e d<d=e e%d>e e%d?e e%d@e e%fdAZ1e!jEdBdgeegddde e'ii2dCZ2e!jEdDdgeegdde e'iiejHddejHddejHddEfde e%de e%dFe e%fdGZ3de%de%fdHZ4e!jkdIdgeegddJdKdLdMdNiidOe6fdPZ7e!jEdQdgeegddde e'ii2ejHddRejHddSejHddTejHddUejHddVejHddWejHddejHddejHdXdYdXZejHd[d\dXd]^eeejHdd_ejHdd`f d=e e%de e%dae e%d?e e%dbe e8dce e8de e%de e%dde9dee9d e)dfe e%de e%fdgZ:edhie!jEdjdgeegdejHddejHddfdae%de e%de e%fdkZ;e!jEdldgeegdde e'iiejHddRejHddSejHddmejHddejHddejHdndoeefd=e e%de e%dae e%de e%de e%dpee!jkdudgeegddvZ?deefd=e e%d e)fdwZ@e!jEdxdgeegdejHddyeefd=e e%d e)fdzZAe!jEd{dgeegdd|ZB dd e)d~e9fdZCe!jEddgeegdejHddeefd~e9d e)fdZDe!jEddgeegddZEe!jEddgeegddZFe!jkddgeegddde eGfdZH dd e)d~e9fdZIe!jEddgeegdejHd}deefd~e9d e)fdZJe!jEdedefdZK dde fdZL dde%de%de e de e%fdZMe!jEddgeegddde e'ii2ejHd,eefde%d e)fdZNdfe e%de e%e ffdZOy)N)datetime timedeltatimezone) lru_cache) TYPE_CHECKINGAnyDictListLiteralOptional) APIRouterDepends HTTPExceptionstatus)verbose_proxy_logger)*)ProviderBudgetResponseProviderBudgetResponseObject)user_api_key_auth)get_spend_by_team_and_customer)handle_exception_on_proxy PrismaClientz /spend/keyszBudget & Spend TrackingF)tags dependenciesinclude_in_schemacKddlm} | td|jddd{}|S7#t$r+}t t j dt|i d}~wwxYww) z View all keys created, ordered by spend Example Request: ``` curl -X GET "http://0.0.0.0:8000/spend/keys" -H "Authorization: Bearer sk-1234" ``` r prisma_clientNDatabase not connected. Connect a database to your proxy - https://docs.litellm.ai/docs/simple_proxy#managing-auth---virtual-keyskeyfind_all table_name query_typeerror status_codedetaillitellm.proxy.proxy_serverr Exceptionget_datarrHTTP_400_BAD_REQUESTstr)rkey_infoes s/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/proxy/spend_tracking/spend_management_endpoints.py spend_key_fnr3s"9   T '//5Z/XXY  33SV$   s0A-#646A-6 A*&A%%A**A-z /spend/userszGet User Table row for user_id)default descriptionuser_idc$Kddlm} | td||jdd|d{}|gS|jdd d{}|S7$7#t$r+}t t j d t|i d}~wwxYww) aD View all users created, ordered by spend Example Request: ``` curl -X GET "http://0.0.0.0:8000/spend/users" -H "Authorization: Bearer sk-1234" ``` View User Table row for user_id ``` curl -X GET "http://0.0.0.0:8000/spend/users?user_id=1234" -H "Authorization: Bearer sk-1234" ``` rrNr user find_unique)r$r%r6r"r#r&r'r*)r6r user_infor1s r2 spend_user_fnr;@s69  T   +44!mW5I; +44!j5I   33SV$   sTB&AAABAAABAA B "&BB  Bz /spend/tagsmodel)rr responsesz*Time from which to start viewing key spendz!Time till which to view key spend start_dateend_datec :K ddlm}ddlm} | td ||||d{}|S#t$r'tdtj j zwxYw79#t$r}t|trKtt|dd t|d d t|d d t|dtjt|tr|tdt|zd t|d d tjd}~wwxYww)ai LiteLLM Enterprise - View Spend Per Request Tag Example Request: ``` curl -X GET "http://0.0.0.0:8000/spend/tags" -H "Authorization: Bearer sk-1234" ``` Spend with Start Date and End Date ``` curl -X GET "http://0.0.0.0:8000/spend/tags?start_date=2022-01-01&end_date=2022-02-01" -H "Authorization: Bearer sk-1234" ``` r)get_spend_by_tagszTrying to use Spend by TagsrNr )r?r@rr)/spend/tags Error()internal_errorparamNoner(messagetyperFcode/spend/tags Error)enterprise.utilsrB ImportErrorr,CommonProxyErrors!missing_enterprise_package_dockervaluer+r isinstancerProxyExceptiongetattrr/rHTTP_500_INTERNAL_SERVER_ERROR)r?r@rBrresponser1s r2view_spend_tagsrWvs6D 6 9#  T   +!HM  5   )AAGG H   ,  a ' 8/A#a&-KL%a&1Q v/T/TU   > *G'#a&0!!Wf-66    sLD4DA)A'A)D0A$$D'A)) D2B!DDDuser_api_key_dictcKddlm}|tdddi|j}|tdddid}|jj ||||d{}|S7w) Nrrr&No db connectedr'No user_id founda0 SELECT date_trunc('day', "startTime") AS date, COUNT(*) AS api_requests, SUM(total_tokens) AS total_tokens FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date + interval '1 day' AND "user" = $3 GROUP BY date_trunc('day', "startTime") r+rrr6db query_rawrXr?r@rr6 sql_query db_responses r2!get_global_activity_internal_userrcs9W>O4PQQ''GW>P4QRR I&((22:xK  AA#A!A#z/global/activity)rrr>rz&Time from which to start viewing spendzTime till which to view spendcLK||ttjdditj|d}tj|d}ddlm} | td|jtjk(s|jtjk(rt|||d{}n'd }|jj|||d{}|gSd}d} g} |D]i} tj| d } | j!d | d <| j#| || j%d dz }| | j%d dz } kt'| d} | || d} | S77#t$r+}ttjdt)|id}~wwxYww)a Get number of API Requests, total tokens through proxy { "daily_data": [ const chartdata = [ { date: 'Jan 22', api_requests: 10, total_tokens: 2000 }, { date: 'Jan 23', api_requests: 10, total_tokens: 12 }, ], "sum_api_requests": 20, "sum_total_tokens": 2012 } Nr&&Please provide start_date and end_dater'%Y-%m-%drrr a\ SELECT date_trunc('day', "startTime") AS date, COUNT(*) AS api_requests, SUM(total_tokens) AS total_tokens FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date + interval '1 day' GROUP BY date_trunc('day', "startTime") date%b %d api_requests total_tokensc |dSNrhxs r2z%get_global_activity..Dair! daily_datasum_api_requestssum_total_tokens)rrr.rstrptimer+rr, user_roleLitellmUserRoles INTERNAL_USERINTERNAL_USER_VIEW_ONLYrcr^r_ fromisoformatstrftimeappendgetsortedr/)r?r@rXstart_date_obj end_date_objrrbrarwrxrvrow _date_objdata_to_returnr1s r2get_global_activityrsTX-33EF  &&z:>N$$Xz:L89  T   ' '+;+I+I I **.>.V.VV A!><!KI!. 0 0 : :><!K  I C ..s6{;I#,,W5CK   c "  : :   : : J,?@ % 0 0  S<  33SV$   s\AF$AE-.E)/'E-E+E-F$B E-(F$)E-+E-- F!6&FF!!F$cKddlm}|tdddi|j}|tdddid}|jj ||||d{}|S7w) NrrrZr&r[r'r\aR SELECT model_group, date_trunc('day', "startTime") AS date, COUNT(*) AS api_requests, SUM(total_tokens) AS total_tokens FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date + interval '1 day' AND "user" = $3 GROUP BY model_group, date_trunc('day', "startTime") r]r`s r2'get_global_activity_model_internal_userrUs9W>O4PQQ''GW>P4QRR I&((22:xK  rdz/global/activity/modelc\K||ttjdditj|d}tj|d}ddlm} | td|jtjk(s|jtjk(rt|||d{}n'd }|jj|||d{}|gSi}|D]} | d } | |vr gddd || <tj| d } | j!d | d <|| dj#| || dxx| j%ddz cc<|| dxx| j%ddz cc<t't)|j+dddd}g} |j+D]2\} }t)|dd}| j#| ||d|dd4| S7A7#t$r+}ttj,dt/|id}~wwxYww)a Get number of API Requests, total tokens through proxy - Grouped by MODEL [ { "model": "gpt-4", "daily_data": [ const chartdata = [ { date: 'Jan 22', api_requests: 10, total_tokens: 2000 }, { date: 'Jan 23', api_requests: 10, total_tokens: 12 }, ], "sum_api_requests": 20, "sum_total_tokens": 2012 }, { "model": "azure/gpt-4-turbo", "daily_data": [ const chartdata = [ { date: 'Jan 22', api_requests: 10, total_tokens: 2000 }, { date: 'Jan 23', api_requests: 10, total_tokens: 12 }, ], "sum_api_requests": 20, "sum_total_tokens": 2012 }, ] Nr&rfr'rgrrr a SELECT model_group, date_trunc('day', "startTime") AS date, COUNT(*) AS api_requests, SUM(total_tokens) AS total_tokens FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date + interval '1 day' GROUP BY model_group, date_trunc('day', "startTime") model_grouprurhrirvrwrjrxrkc|ddS)Nrwrnros r2rqz+get_global_activity_model..sad#56rsTr!reverse c |dSrmrnros r2rqz+get_global_activity_model..& rsrt)r=rvrwrx)rrr.rryr+rr,rzr{r|r}rr^r_r~rrrdictritemsrUr/)r?r@rXrrrrbra model_ui_datar_modelrrVr=data_sort_daily_datar1s r2get_global_activity_modelrssBX-33EF  &&z:>N$$Xz:L8M  T   ' '+;+I+I I **.>.V.VV G!><!K I!. 0 0 : :><!K  I  C'F]*"$()()) f% !..s6{;I#,,W5CK & !, / 6 6s ; & !"4 5QR9S S 5 & !"4 5QR9S S 5  ##%6 r   (..0KE4%d<&8>QR  OO""2(,-?(@(,-?(@  1{b  ==SV$   s\AH,AG5.G//'G5G2G5H,DG5.H,/G52G55 H)>&H$$H))H,z&/global/activity/exceptions/deploymentzFilter by model group)r5rclK||ttjdditj|d}tj|d}ddlm} | tdd }|jj||||d{}|gSi}|D]v} | d } | |vrgdd || <tj| d } | jd | d <|| dj| || dxx| jddz cc<xtt|j!dddd}g} |j!D].\} }t|dd}| j| ||dd0| S7#t$r+}ttj"dt%|id}~wwxYww)a Get number of 429 errors - Grouped by deployment [ { "deployment": "https://azure-us-east-1.openai.azure.com/", "daily_data": [ const chartdata = [ { date: 'Jan 22', num_rate_limit_exceptions: 10 }, { date: 'Jan 23', num_rate_limit_exceptions: 12 }, ], "sum_num_rate_limit_exceptions": 20, }, { "deployment": "https://azure-us-east-1.openai.azure.com/", "daily_data": [ const chartdata = [ { date: 'Jan 22', num_rate_limit_exceptions: 10, }, { date: 'Jan 23', num_rate_limit_exceptions: 12 }, ], "sum_num_rate_limit_exceptions": 20, }, ] Nr&rfr'rgrrr a SELECT api_base, date_trunc('day', "startTime")::date AS date, COUNT(*) AS num_rate_limit_exceptions FROM "LiteLLM_ErrorLogs" WHERE "startTime" >= $1::date AND "startTime" < ($2::date + INTERVAL '1 day') AND model_group = $3 AND status_code = '429' GROUP BY api_base, date_trunc('day', "startTime") ORDER BY date; api_baservsum_num_rate_limit_exceptionsrhrirvrnum_rate_limit_exceptionsc|ddS)Nrrrnros r2rqz?get_global_activity_exceptions_per_deployment..sad#BCrsTrrc |dSrmrnros r2rqz?get_global_activity_exceptions_per_deployment..rrsrt)rrvr)rrr.rryr+rr,r^r_r~rrrrrrrUr/)rr?r@rrrrarbrrrrrVr=rrr1s r2-get_global_activity_exceptions_per_deploymentrszX-33EF  &&z:>N$$Xz:L8N  T  $*,,66 ~|[    I  C_F]*"$56) f%!..s6{;I#,,W5CK & !, / 6 6s ; & !"A Bcgg+QG  B  ##%C r   (..0KE4%d<&8>QR  OO %"25976 1a d  ==SV$   sIAF40E=E;E=F4C*E=:F4;E== F1&F,,F11F4z/global/activity/exceptionsczK||ttjdditj|d}tj|d}ddlm} | tdd }|jj||||d{}|gSd}g} |D]T} tj| d } | jd | d <| j| || jd dz }Vt| d } | |d} | S7z#t$r+} ttjdt| id} ~ wwxYww)a Get number of API Requests, total tokens through proxy { "daily_data": [ const chartdata = [ { date: 'Jan 22', num_rate_limit_exceptions: 10, }, { date: 'Jan 23', num_rate_limit_exceptions: 10, }, ], "sum_api_exceptions": 20, } Nr&rfr'rgrrr a SELECT date_trunc('day', "startTime")::date AS date, COUNT(*) AS num_rate_limit_exceptions FROM "LiteLLM_ErrorLogs" WHERE "startTime" >= $1::date AND "startTime" < ($2::date + INTERVAL '1 day') AND model_group = $3 AND status_code = '429' GROUP BY date_trunc('day', "startTime") ORDER BY date; rhrirc |dSrmrnros r2rqz0get_global_activity_exceptions..rrrsrtr)rrr.rryr+rr,r^r_r~rrrrr/)rr?r@rrrrarbrrvrrrr1s r2get_global_activity_exceptionsrsuRX-33EF  &&z:>N$$Xz:L85  T  *,,66 ~|[    I()% C ..s6{;I#,,W5CK   c " )SWW5PRS-T T ) J,?@ %-J  3 6  33SV$   sIAD;0DDDD;A1DD;D D8 &D33D88D;z/global/spend/provider)rrrr>cvKddlm}||ttjddit j |d}t j |d}ddlm}m } | td |jtjk(s|jtjk(rF|j}|td dd id } |j j#| |||d{} n'd } |j j#| ||d{} | gSg} |t$} | D]} | d}d}| |j'|}|" t)j*|j,j.|j,j0|j,j2|j,\}}}}| |xx| dz cc<| j5D]\}}| j7||d| S77#t$rYwxYw#t$r+}ttjdt9|id}~wwxYww)a- Get breakdown of spend per provider [ { "provider": "Azure OpenAI", "spend": 20 }, { "provider": "OpenAI", "spend": 10 }, { "provider": "VertexAI", "spend": 30 } ] r) defaultdictNr&rfr'rg) llm_routerrr r\a SELECT model_id, SUM(spend) AS spend FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date AND length(model_id) > 0 AND "user" = $3 GROUP BY model_id z SELECT model_id, SUM(spend) AS spend FROM "LiteLLM_SpendLogs" WHERE "startTime" BETWEEN $1::date AND $2::date AND length(model_id) > 0 GROUP BY model_id model_idUnknown)r)r=custom_llm_providerrlitellm_paramsspend)providerr) collectionsrrrr.rryr+rrr,rzr{r|r}r6r^r_intget_deploymentlitellmget_llm_providerrr=rrrrr/)r?r@rXrrrrrr6rarb ui_responseprovider_spend_mappingr _model_id _provider _deployment_rrr1s r2get_global_spend_providerrspJ(X-33EF  &&z:>N$$Xz:LDN  T   ' '+;+I+I I **.>.V.VV'//G# #W6H,I I!. 0 0 : :><!KI!. 0 0 : :><!K  I .9#.>CJI!I%(777K * -4-E-E"-"<"<"B"B0;0J0J0^0^%0%?%?%H%H+6+E+E .*9a /y9S\I9" 6;;=OHe   HuE F >]8%  33SV$   sAH9BH&G.''HG1HH9H4H A4G3>/H-H9.H1H3 G?<H>G??H H6 &H11H66H9z/global/spend/reportteamz3Group spend by internal team or customer or api_keyz;View spend for a specific api_key. Example api_key='sk-1234zJView spend for a specific internal_user_id. Example internal_user_id='1234z8View spend for a specific team_id. Example team_id='1234zrView spend for a specific customer_id. Example customer_id='1234. Can be used in conjunction with team_id as well.group_by)rcustomerapi_keyrinternal_user_idteam_id customer_idcK||ttjdditj|d}tj|d}ddlm} m}  | td| d ur;tjd td tjjz|atjd ||jd r t!|}d} | j"j%| |||d{} | gS| S|Dtjd|d} | j"j%| |||d{} | gS| S||t'||||| d{S|dk(r-d} | j"j%| ||d{} | gS| S|dk(r-d} | j"j%| ||d{} | gS| S|dk(r-d} | j"j%| ||d{} | gS| Sy7777v7F7#t$r+} ttjdt)| id} ~ wwxYww)a Get Daily Spend per Team, based on specific startTime and endTime. Per team, view usage by each key, model [ { "group-by-day": "2024-05-10", "teams": [ { "team_name": "team-1" "spend": 10, "keys": [ "key": "1213", "usage": { "model-1": { "cost": 12.50, "input_tokens": 1000, "output_tokens": 5000, "requests": 100 }, "audio-modelname1": { "cost": 25.50, "seconds": 25, "requests": 50 }, } } ] ] } Nr&rfr'rgr) premium_userrr Tz.accessing /spend/report but not a premium userz/spend/report endpoint zGetting /spend for api_key: %ssk-tokenad WITH SpendByModelApiKey AS ( SELECT sl.api_key, sl.model, SUM(sl.spend) AS model_cost, SUM(sl.prompt_tokens) AS model_input_tokens, SUM(sl.completion_tokens) AS model_output_tokens FROM "LiteLLM_SpendLogs" sl WHERE sl."startTime" BETWEEN $1::date AND $2::date AND sl.api_key = $3 GROUP BY sl.api_key, sl.model ) SELECT api_key, SUM(model_cost) AS total_cost, SUM(model_input_tokens) AS total_input_tokens, SUM(model_output_tokens) AS total_output_tokens, jsonb_agg(jsonb_build_object( 'model', model, 'total_cost', model_cost, 'total_input_tokens', model_input_tokens, 'total_output_tokens', model_output_tokens )) AS model_details FROM SpendByModelApiKey GROUP BY api_key ORDER BY total_cost DESC; z'Getting /spend for internal_user_id: %saa WITH SpendByModelApiKey AS ( SELECT sl.api_key, sl.model, SUM(sl.spend) AS model_cost, SUM(sl.prompt_tokens) AS model_input_tokens, SUM(sl.completion_tokens) AS model_output_tokens FROM "LiteLLM_SpendLogs" sl WHERE sl."startTime" BETWEEN $1::date AND $2::date AND sl.user = $3 GROUP BY sl.api_key, sl.model ) SELECT api_key, SUM(model_cost) AS total_cost, SUM(model_input_tokens) AS total_input_tokens, SUM(model_output_tokens) AS total_output_tokens, jsonb_agg(jsonb_build_object( 'model', model, 'total_cost', model_cost, 'total_input_tokens', model_input_tokens, 'total_output_tokens', model_output_tokens )) AS model_details FROM SpendByModelApiKey GROUP BY api_key ORDER BY total_cost DESC; ra WITH SpendByModelApiKey AS ( SELECT date_trunc('day', sl."startTime") AS group_by_day, COALESCE(tt.team_alias, 'Unassigned Team') AS team_name, sl.model, sl.api_key, SUM(sl.spend) AS model_api_spend, SUM(sl.total_tokens) AS model_api_tokens FROM "LiteLLM_SpendLogs" sl LEFT JOIN "LiteLLM_TeamTable" tt ON sl.team_id = tt.team_id WHERE sl."startTime" BETWEEN $1::date AND $2::date GROUP BY date_trunc('day', sl."startTime"), tt.team_alias, sl.model, sl.api_key ) SELECT group_by_day, jsonb_agg(jsonb_build_object( 'team_name', team_name, 'total_spend', total_spend, 'metadata', metadata )) AS teams FROM ( SELECT group_by_day, team_name, SUM(model_api_spend) AS total_spend, jsonb_agg(jsonb_build_object( 'model', model, 'api_key', api_key, 'spend', model_api_spend, 'total_tokens', model_api_tokens )) AS metadata FROM SpendByModelApiKey GROUP BY group_by_day, team_name ) AS aggregated GROUP BY group_by_day ORDER BY group_by_day; ra WITH SpendByModelApiKey AS ( SELECT date_trunc('day', sl."startTime") AS group_by_day, sl.end_user AS customer, sl.model, sl.api_key, SUM(sl.spend) AS model_api_spend, SUM(sl.total_tokens) AS model_api_tokens FROM "LiteLLM_SpendLogs" sl WHERE sl."startTime" BETWEEN $1::date AND $2::date GROUP BY date_trunc('day', sl."startTime"), customer, sl.model, sl.api_key ) SELECT group_by_day, jsonb_agg(jsonb_build_object( 'customer', customer, 'total_spend', total_spend, 'metadata', metadata )) AS customers FROM ( SELECT group_by_day, customer, SUM(model_api_spend) AS total_spend, jsonb_agg(jsonb_build_object( 'model', model, 'api_key', api_key, 'spend', model_api_spend, 'total_tokens', model_api_tokens )) AS metadata FROM SpendByModelApiKey GROUP BY group_by_day, customer ) AS aggregated GROUP BY group_by_day ORDER BY group_by_day; raP WITH SpendByModelApiKey AS ( SELECT sl.api_key, sl.model, SUM(sl.spend) AS model_cost, SUM(sl.prompt_tokens) AS model_input_tokens, SUM(sl.completion_tokens) AS model_output_tokens FROM "LiteLLM_SpendLogs" sl WHERE sl."startTime" BETWEEN $1::date AND $2::date GROUP BY sl.api_key, sl.model ) SELECT api_key, SUM(model_cost) AS total_cost, SUM(model_input_tokens) AS total_input_tokens, SUM(model_output_tokens) AS total_output_tokens, jsonb_agg(jsonb_build_object( 'model', model, 'total_cost', model_cost, 'total_input_tokens', model_input_tokens, 'total_output_tokens', model_output_tokens )) AS model_details FROM SpendByModelApiKey GROUP BY api_key ORDER BY total_cost DESC; )rrr.rryr+rrr,rdebug ValueErrorrOnot_premium_userrQ startswith hash_tokenr^r_rr/)r?r@rrrrrrrrrrarbr1s r2get_global_spend_reportrsFX-33EF  &&z:>N$$Xz:LFT  T  t # & &'W X),=,N,N,T,TT    & &'G Q!!%($73!ID!. 0 0 : :><!K"    ) & &9;K !ID!. 0 0 : :><9I!K"    [%<7 g{M  v 4Il!. 0 0 : :><!K"    #1If!. 0 0 : :><!K"    "!ID!. 0 0 : :><!K"  S#iZxxT  33SV$   sAIB$H =H>H IH I;H HH I H IH $H%H (I)'H HH IH I'H H H I H I 'H 4H 5H <I=H >IH H H H H H I&H<<IIz/global/spend/all_tag_namesc FK ddlm}| tdd}|jj |d{}|gSg}|D]"}|j |j d$d|iS75#t$r}t|trKtt|ddt|d d t|d d t|d tjt|tr|tdt|zd t|d d tjd}~wwxYww)Nrrr z SELECT DISTINCT jsonb_array_elements_text(request_tags) AS individual_request_tag FROM "LiteLLM_SpendLogs"; individual_request_tag tag_namesr)z/spend/all_tag_names Error(rDrErFrGr(rHz/spend/all_tag_names Error)r+rr,r^r_rrrRrrSrTr/rrU)rrarb _tag_namesrr1s r2global_get_all_tag_namesrs4' <  T  *,,66yAA  I C   cgg&>? @Z((B  a ' 8/J3q6(RS-TU%a&1Q v/T/TU   > *G03q69!!Wf-66    sDD!3A/A-A/D!,A/,D!-A// D8B!DDD!z/global/spend/tagsz"comman separated tags to filter onrc 4Kddl}ddlm} | td||t dddt j t||||d{}|S7#t$r}|j}t|d z|z}t|trBt t|d d |d d t|ddt|dt jt|tr|t d|zd t|ddt jd}~wwxYww)a} LiteLLM Enterprise - View Spend Per Request Tag. Used by LiteLLM UI Example Request: ``` curl -X GET "http://0.0.0.0:4000/spend/tags" -H "Authorization: Bearer sk-1234" ``` Spend with Start Date and End Date ``` curl -X GET "http://0.0.0.0:4000/spend/tags?start_date=2022-01-01&end_date=2022-02-01" -H "Authorization: Bearer sk-1234" ``` rNrr rf bad_requestrH)r?r@tags_strr r)rCrDrErFrGr(rL) tracebackr+rr,rSrr.ui_get_spend_by_tags format_excr/rRrrTrU) r?r@rrrrVr1 error_trace error_strs r2global_view_spend_tagsr0s?J8&  T   z1 @"00   .!'      **, FTMK/ a ' 8/A)A-NO%a&1Q v/T/TU   > *G')3!!Wf-66    s< DAAAADA D B0DDDczKddlm}|tjdy d}|jj |||d{}d}|jj |||d{}||fS7/7 #t $r7}tjdjt|Yd}~yd}~wwxYww)NrrzZDatabase not connected. Connect a database to your proxy for weekly, monthly spend reportsa SELECT t.team_alias, SUM(s.spend) AS total_spend FROM "LiteLLM_SpendLogs" s LEFT JOIN "LiteLLM_TeamTable" t ON s.team_id = t.team_id WHERE s."startTime"::DATE >= $1::date AND s."startTime"::DATE <= $2::date GROUP BY t.team_alias ORDER BY total_spend DESC; a@ SELECT jsonb_array_elements_text(request_tags) AS individual_request_tag, SUM(spend) AS total_spend FROM "LiteLLM_SpendLogs" WHERE "startTime"::DATE >= $1::date AND "startTime"::DATE <= $2::date GROUP BY individual_request_tag ORDER BY total_spend DESC; z(Exception in _get_daily_spend_reports {}) r+rrr&r^r_r,formatr/)r?r@rrarV spend_per_tagr1s r2 _get_spend_report_for_time_rangers9"" h %  '))33Iz8TT ,..88 z8  &&#U  "" 6 = =c!f E   sRB;"A8A4&A8+A6,A83B;4A86A88 B8-B3.B;3B88B;z/spend/calculatecostzThe calculated costfloat)r5examplerJrequestc K ddlm}ddlm}ddlm}d}|j A|j tddd}d}||jZ|j |jvrB|j|j }|jD]}|jd |k(s|}n2|jD]#}|jd |j k(s"|}% |h|jd } | jd } | jd } | jd } | | || | }|| |j|}na||j |j}nB|j)tjdi|j} || }n tddd|iS#t$r}t|trRt!t#|dt%|t#|ddt#|ddt#|dt&j(t%|}t!t#|d|t#|ddt#|ddt#|ddd}~wwxYww)a Accepts all the params of completion_cost. Calculate spend **before** making call: Note: If you see a spend of $0.0 you need to set custom_pricing for your model: https://docs.litellm.ai/docs/proxy/custom_pricing ``` curl --location 'http://localhost:4000/spend/calculate' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "model": "anthropic.claude-v2", "messages": [{"role": "user", "content": "Hey, how'''s it going?"}] }' ``` Calculate spend **after** making call: ``` curl --location 'http://localhost:4000/spend/calculate' --header 'Authorization: Bearer sk-1234' --header 'Content-Type: application/json' --data '{ "completion_response": { "id": "chatcmpl-123", "object": "chat.completion", "created": 1677652288, "model": "gpt-3.5-turbo-0125", "system_fingerprint": "fp_44709d6fcb", "choices": [{ "index": 0, "message": { "role": "assistant", "content": "Hello there, how may I assist you today?" }, "logprobs": null, "finish_reason": "stop" }] "usage": { "prompt_tokens": 9, "completion_tokens": 12, "total_tokens": 21 } } }' ``` r)completion_cost) CostPerTokenrNrz>Bad Request - messages must be provided if 'model' is providedr' model_namerr=input_cost_per_tokenoutput_cost_per_token)rr)r=messagescustom_cost_per_token)r=r)completion_responsezFBad Request - Either 'model' or 'completion_response' must be providedrr)rJrGrFr(rHrIrZrn)rrlitellm.cost_calculatorrr+rr=rrmodel_group_alias model_listrr ModelResponser,rRrSrTr/rr.)rrrr_cost_model_in_llm_routercost_per_token_model_group_namer=_litellm_params_litellm_model_namerr_completion_responser1 error_msgs r2calculate_spendrs}~V +89 == $'# #[ $( 59N%00< )E)EE)3(D(DW]](S%!+!6!6 99\26GG380"7",!6!6 99\2gmmC380"7 $/"6":":;K"L&5&9&9'&B#'6':':;Q'R$(7(;(; has_request_response_payload - if so, it will return the request and response payload Nr r )rstart_time_utc end_time_utc) rlogging_callback_manager6get_active_additional_logging_utils_from_custom_loggerrryrrrget_request_response_payload)rr?r@custom_loggersrr custom_loggerpayloads r2'ui_view_request_response_for_request_idr6s2 ((__a*.N'+L!**:7JKSS<<T ((3FGOO<<P ( %BB!)%C    N(  sB+B=-B;.B=5B=z /spend/logszjrequest_id to get spend logs for specific request_id. If none passed then pass spend logs for all requestsTzWhen start_date and end_date are provided, summarize=true returns aggregated data by date (legacy behavior), summarize=false returns filtered individual logs summarizec Kddlm}|jtjk(s|jtj k(r |j } tjd| tdg}|0t|tr|t|tr tj|d} tj|d} d| | di} |t|tr|| d <n/|t|tr|| d <n|t|tr|| d <|s3|jjj!| dd i d{} | S|jjj#gd| ddid{} t| t$rt'| dkDrt| dt(ri}| D]T}tjt|dd}|j+}||vriid||<|d }|d }|d}||j-dd|j-dij-ddz||d<||j-|d|j-dij-ddz|||<||dj-|d|j-dij-ddz||d|<||dj-|d|j-dij-ddz||d|<Wg}d}t/|j1D]\}}|j3i|d|i|} | j+}|D||kr?|t5dz}||kr+|j3|diid|t5dz }||kr+|S| S|jt|trZ|j7dr|j9|}n|}|j;ddd |dd{}t|t$r|S|gS|"|j;dd d |dd{}|gS|4|j;ddd |dd{}t|t$r|S|gS|j;dd!d{}|S7F777b7@7#t$r}t|t<rKt?tA|d"d#t|d$d%tA|d&d'tA|d(tBjD)t|t>r|t?d*t|zd%tA|d&d'tBjD)d}~wwxYww)+a View all spend logs, if request_id is provided, only logs for that request_id will be returned When start_date and end_date are provided: - summarize=true (default): Returns aggregated spend data grouped by date (maintains backward compatibility) - summarize=false: Returns filtered individual log entries within the date range Example Request for all logs ``` curl -X GET "http://0.0.0.0:8000/spend/logs" -H "Authorization: Bearer sk-1234" ``` Example Request for specific request_id ``` curl -X GET "http://0.0.0.0:8000/spend/logs?request_id=chatcmpl-6dcb2540-d3d7-4e49-bb27-291f863f112e" -H "Authorization: Bearer sk-1234" ``` Example Request for specific api_key ``` curl -X GET "http://0.0.0.0:8000/spend/logs?api_key=sk-Fn8Ej39NkBQmUagFEoUWPQ" -H "Authorization: Bearer sk-1234" ``` Example Request for specific user_id ``` curl -X GET "http://0.0.0.0:8000/spend/logs?user_id=ishaan@berri.ai" -H "Authorization: Bearer sk-1234" ``` Example Request for date range with individual logs (unsummarized) ``` curl -X GET "http://0.0.0.0:8000/spend/logs?start_date=2024-01-01&end_date=2024-01-02&summarize=false" -H "Authorization: Bearer sk-1234" ``` rrzinside view_spend_logsNr rgr r rrr8rrr)rr8r=r rT)byrsumz%Y-%m-%dT%H:%M:%S.%fZ)usersmodelsr=_sumr<r=rdays)r rr<r=rrr")r!rQ)r$r%key_valr9r#r)z/spend/logs Error(rDrErFrGr(rHz/spend/logs Error)#r+rrzr{r|r}r6rrr,rRr/rryr^rr!rlistlenrrhrrrrrrrr-rrSrTrrU)rr6rr?r@r7rXr spend_logsrr filter_queryrrVresultrecord dt_objectrhr= return_list final_datekv end_date_date current_date hashed_token spend_logr1s r2view_spend_logsrQ$sP9 ##'7'E'EE  & &*:*R*R R#++^ ""#;<  T   ":s+$8S)&..z:FN#,,XzBL)'L"z'3'?*1 Y''Jz3,G-7 \*$GS)A'. V$*--??II&#VJ  +--??HH<"TIH8T*MA%x{D1!&F ( 1 1#f[6I2JLc dI$>>+D6)13r'Bt $Y/G$VnG"7OE,24L,<,6?F4L)'25;4L4J4N4Nq5 62.227A>5?F4L*51#'(! ! "6<<>2DAq&&' *G'#a&0!!Wf-66    sA U C4RR R U  /R:R ;H'R#R$U %R&U 'AR9R:RU RU R/R0R6U 7RRR)U *R,U -RRR U  R RRRRR U!B!UUU z/global/spend/reset)rrc*Kddlm}|tdddtj|j j jdd ii d{|j jjdd ii d{d d d S7:7 w)aC ADMIN ONLY / MASTER KEY Only Endpoint Globally reset spend for All API Keys and Teams, maintain LiteLLM_SpendLogs 1. LiteLLM_SpendLogs will maintain the logs on spend, no data gets deleted from there 2. LiteLLM_VerificationTokens spend will be set = 0 3. LiteLLM_TeamTable spend will be set = 0 rrNrrErGrHrr)rrz3Spend for all API Keys and Teams reset successfullysuccessrIr) r+rrSrrr^litellm_verificationtoken update_manylitellm_teamtablers r2global_spend_resetrXs 96!--       4 4 @ @s^2 A     , , 8 8wnTV 8 WWWI  Xs$ABB0BB BBz/global/spend/refreshc Kddlm  tdddtjdt f fd }|d{}|rd } dd lm}dd lm}dd l m }tjd}|t|jj|||ddi}|j j#d{|j j%|d{t'j(ddddSy77D7##t$r<}t'j*dj-t/|dddcYd}~Sd}~wwxYww)zc ADMIN ONLY / MASTER KEY Only Endpoint Globally refresh spend MonthlyGlobalSpend view rrNrrErGrHreturncKd} jj|d{}|dddk(S7#t$rYywxYww)zM Return True if materialized view exists Else False zy SELECT relname, relkind FROM pg_class WHERE relname = 'MonthlyGlobalSpend'; NrrelkindmF)r^r_r,)raresprs r2!is_materialized_global_spend_viewz?global_spend_refresh..is_materialized_global_spend_viewQsX   &))33I>>D79%, ,?  s1A757A7 AAAAzE REFRESH MATERIALIZED VIEW "MonthlyGlobalSpend"; )rO)proxy_logging_objr DATABASE_URLtimeoutip) database_urlr` http_clientz!MonthlyGlobalSpend view refreshedrSrTz(Failed to refresh materialized view - {}z#Failed to refresh materialized viewfailure)r+rrSrrboollitellm.proxy._typesrOr`litellm.proxy.utilsrosgetenvr,db_not_connected_errorrQr^connectr_rinfor$rr/) r_ view_existsrarOr`rdb_url new_clientr1rs @r2global_spend_refreshrq:sN96!--   T$:;;K   > D 8YY~.F~ 1 H H N NOO%#"3tJ--'') ) )--)))4 4 4 % %&I J># /<, * 4  * *:AA#a&I A#   seE  A2D;D<"DDD<E DD E  1E>E ?E E  E cKddlm}|tdddtj |j }| t d|)d}|jj|||d{}|Sd }|jj||d{}|S7.7#t$r(}tjd t||d}~wwxYww) NrrrrErGrHz)/global/spend/logs Error: User ID is Nonez SELECT * FROM "MonthlyGlobalSpendPerUserPerKey" WHERE "api_key" = $1 AND "user" = $2 ORDER BY "date"; zSSELECT * FROM "MonthlyGlobalSpendPerUserPerKey" WHERE "user" = $1 ORDER BY "date";/global/spend/logs Error: ) r+rrSrrUr6rr^r_r,rr&r/)rrXrr6rarVr1s r2global_spend_for_internal_userrts96!66   #++ ?HI I  I +--77 7GTTHOm &))33IwGGU H ""%?Ax#HIsX&C =B&B'B,C -!BBBC BB C "#CC  C z/global/spend/logszMAPI Key to get global spend (spend per day for last 30d). Admin-only endpointc Kddl}ddlm}m}ddlm} |t dddtj|jtjk(s|jtjk(rt|| d{}|S|}|r|| d{}|S|(d }|jj| d{}|Sd }|jj||d{}|S7t7Z727 #t $r} |j#} t%| dz| z} t'j(d| t+| t,rBt t/| dd| ddt/| ddt/| dtjt+| t r| t d| zdt/| ddtjd} ~ wwxYww)z [BETA] This is a beta endpoint. It will change. Use this to get global spend (spend per day for last 30d). Admin-only endpoint More efficient implementation of /spend/logs, by creating a view over the spend logs table. rN)get_daily_spend_from_prometheusis_prometheus_connectedrrrErGrH)rrX)rz3SELECT * FROM "MonthlyGlobalSpend" ORDER BY "date";queryz SELECT * FROM "MonthlyGlobalSpendPerKey" WHERE "api_key" = $1 ORDER BY "date"; rrsr)z/global/spend/logs Error(rDrFr(z/global/spend/logs Error)r6litellm.integrations.prometheus_helpers.prometheus_apirvrwr+rrSrrUrzr{r|r}rtr^r_r,rr/rr&rRrrT) rrXrrvrwrrVprometheus_api_enabledrar1rrs r2global_spend_logsr|s(9<   :%::    ' '+;+I+I I **.>.V.VV;3DHO!8!: ! *G.:!!Wf-66    sGA)C<?C4C<GC<C6C<!G"#C<C8C< G !C<-C:.C<3G4C<6C<8C<:C<< GCG  GGz /global/spendc Kddl}ddlm} d}|tdddid }|jj | d{}|3t |tr#t|dkDr|djd d}|tjd S7L#t$r}|j}t|d z|z}t |trBtt!|dd|ddt!|ddt!|dt"j$t |tr|td|zdt!|ddt"j$d}~wwxYww)ze [BETA] This is a beta endpoint. It will change. View total spend across all proxy keys rNrrrZr&r[r'z;SELECT SUM(spend) as total_spend FROM "MonthlyGlobalSpend";rx total_spend)r max_budgetrr)z/global/spend Error(rDrErFrGr(rHz/global/spend Error)rr+rrr^r_rRrBrCrrrr,rr/rSrTrrU)rrr~rarVr1rrs r2 global_spendr sU8   CBS8TU UU &))33)3DD  (D)c(ma.?&qkoomSA $G4F4FGG E  **, FTMK/ a ' 8/CI;a-PQ%a&1Q v/T/TU   > *G)I5!!Wf-66    s< E4BBA BEB EB0E  EErlimitcKddlm}|tdddi|j}|tdddid}|jj |||d{}|S7w) NrrrZr&r[r'r\a WITH top_api_keys AS ( SELECT api_key, SUM(spend) as total_spend FROM "LiteLLM_SpendLogs" WHERE "user" = $1 GROUP BY api_key ORDER BY total_spend DESC LIMIT $2 -- Adjust this number to get more or fewer top keys ) SELECT t.api_key, t.total_spend, v.key_alias, v.key_name FROM top_api_keys t LEFT JOIN "LiteLLM_VerificationToken" v ON t.api_key = v.token ORDER BY t.total_spend DESC; r]rXrrr6rarVs r2global_spend_key_internal_userr< sx9W>O4PQQ''GW>P4QRRI:#%%// 7EJJH OKAA"A A"z/global/spend/keysz0Number of keys to get. Will return Top 'n' keys.c Kddlm}|jtjk(s|jtj k(rt |d{}|S|tdddid }|%|jj|d{}|S t|}|d kr td d }|jj||d{}|S77L7 #t$r}td dd|d|i|d}~wwxYww) [BETA] This is a beta endpoint. It will change. Use this to get the top 'n' keys with the highest spend, ordered by spend. rr)rXNrZr&r[r'z#SELECT * FROM "Last30dKeysBySpend";rzLimit must be greater than 0z-SELECT * FROM "Last30dKeysBySpend" LIMIT $1 ;izInvalid limit: z , error: ) r+rrzr{r|r}rrr^r_rr)rrXrrVrar1s r2global_spend_keysrj s"$9 ##'7'E'EE  & &*:*R*R R7/  W>O4PQQ9I }&))33I>> E  19;< <G &))33IuEE O/ ?F WwiPQs.S$T  sZADC9D C D= CURRENT_DATE - INTERVAL '30 days' GROUP BY t.team_alias, DATE(s."startTime") ORDER BY spend_date; rx spend_date team_alias Unassignedr~c |dSNrrn)items r2rqz'global_spend_per_team.. sd1grsTrr)rr~rh) daily_spendteamstotal_spend_per_team)r+rrr^r_setaddroundrrrrCrrB)rrarV spend_by_date team_aliasesrrrow_daterrcurrent_date_entriestotal_spend_per_team_uir response_datar!rQs r2global_spend_per_teamr s9W>O4PQQ I"#%%//i/@@HM5L|$   &  %J$ } $ &E%OE#0#: /4  , &E%OE'15&9M( # - -  , 5 ,/4  ,/2!#))+1EtT( & '2 -  ?"G&&0DW0M N (Mc"fc3U34 %l# 7 kAs9EEDEz/global/all_end_userscKddlm}|tdddid}|jj | d{}|gSg}|D]}|j |d d |iS7)w) zn [BETA] This is a beta endpoint. It will change. Use this to just get all the unique `end_users` rrNrZr&r[r'z; SELECT DISTINCT end_user FROM "LiteLLM_SpendLogs" rxend_user end_users)r+rrr^r_r)rrarb _end_usersrs r2global_view_all_end_usersr s9W>O4PQQI&((222CCK J#j/*  $$Ds9A'A%*A'z/global/spend/end_usersrcdKddlm}|tdddi d}d}d}|$|j}|j}|j }|xs!t jtd z }|xst j}d }|jj||||d{}|S7w) rrrNrZr&r[r'r?a8 SELECT end_user, COUNT(*) AS total_count, SUM(spend) AS total_spend FROM "LiteLLM_SpendLogs" WHERE "startTime" >= $1::timestamp AND "startTime" < $2::timestamp AND ( CASE WHEN $3::TEXT IS NULL THEN TRUE ELSE api_key = $3 END ) GROUP BY end_user ORDER BY total_spend DESC LIMIT 100 ) r+rrr endTimerrnowrr^r_)rrr rselected_api_keyrarVs r2global_spend_end_usersr s9W>O4PQQIG NN ,,<<@X\\^iR.@@I'GI#%%//9g'7H O sB%B0'B.(B0cKddlm}|tdddi|j}|tdddid}|jj |||d{}|S7w) NrrrZr&r[r'r\a7 SELECT model, SUM(spend) as total_spend, SUM(total_tokens) as total_tokens FROM "LiteLLM_SpendLogs" WHERE "user" = $1 GROUP BY model ORDER BY total_spend DESC LIMIT $2; r]rs r2!global_spend_models_internal_userrN sx9W>O4PQQ''GW>P4QRRI #%%// 7EJJH OKrz/global/spend/modelsz4Number of models to get. Will return Top 'n' models.cDKddlm}|jtjk(s|jtj k(rt ||d{}|S|tdddid }|jj|t|d{}|S7H7w) z [BETA] This is a beta endpoint. It will change. Use this to get the top 'n' models with the highest spend, ordered by spend. rr)rXrNrZr&r[r'z/SELECT * FROM "Last30dModelsBySpend" LIMIT $1 ;) r+rrzr{r|r}rrr^r_r)rrXrrVras r2global_spend_modelsro s$9 ##'7'E'EE  & &*:*R*R R:/u  W>O4PQQEI"%%// 3u:FFH O Gs%AB BAB BB B z/provider/budgets)response_modelrZcdKddlm} |tdddi|j}| t di}|j D]\}}|j t d |j j|d{xsd }|j j|d{}t|j|j|| }|||<t| S7a7<#t$r=}tjd j!t#|t%|d}~wwxYww)a Provider Budget Routing - Get Budget, Spend Details https://docs.litellm.ai/docs/proxy/provider_budget_routing Use this endpoint to check current budget, spend and budget reset time for a provider Example Request ```bash curl -X GET http://localhost:4000/provider/budgets -H "Content-Type: application/json" -H "Authorization: Bearer sk-1234" ``` Example Response ```json { "providers": { "openai": { "budget_limit": 1e-12, "time_period": "1d", "spend": 0.0, "budget_reset_at": null }, "azure": { "budget_limit": 100.0, "time_period": "1d", "spend": 0.0, "budget_reset_at": null }, "anthropic": { "budget_limit": 100.0, "time_period": "10d", "spend": 0.0, "budget_reset_at": null }, "vertex_ai": { "budget_limit": 100.0, "time_period": "12d", "spend": 0.0, "budget_reset_at": null } } } ``` rrNrZr&zNo llm_router foundr'zNo provider budget config found. Please set a provider budget config in the router settings. https://docs.litellm.ai/docs/proxy/provider_budget_routingzNo router budget logger foundr) budget_limit time_periodrbudget_reset_at) providersz)/provider/budgets: Exception occured - {})r+rrprovider_budget_configrrrouter_budget_logger_get_current_provider_spend%_get_current_provider_budget_reset_atrrbudget_durationrr,rr$rr/r) rrprovider_budget_response_dictr _budget_info_provider_spend_provider_budget_ttlprovider_budget_response_objectr1s r2provider_budgetsr shb6%+  2G(H ",!B!B ! )j RT%'='C'C'E #I|..6 !@AA 55QQ  *4)H)H)n)n*$ /K)44(88% 4 / + 8W )) 4%(F&&0MNN $ +&& 7 > >s1v F (** +sMD0A7C'C#&C'(C%)9C'"D0#C'%C'' D-08D((D--D0rcXK|jjdd{}|S7w)Nz SELECT jsonb_array_elements_text(request_tags) AS individual_request_tag, COUNT(*) AS log_count, SUM(spend) AS total_spend FROM "LiteLLM_SpendLogs" GROUP BY individual_request_tag; )r^r_)rr?r@rVs r2rBrB s4#%%//   H O s *(*rcKd}|t|dkDr|jd}|tdddid}|t|tr,d|vr(d }|j j |||d{}n(d }|j j ||||d{}tjt}tjt}|D])} | d } | d } || xx| z cc<|| xx| d z cc<+t|jdd} g} | D]C}|d}|t|tr t|d}| j|d|||ddEd| iS77ѭw)z Should cover 2 cases: 1. When user is getting spend for all_tags. "all_tags" in tags_list 2. When user is getting spend for specific tags. Nr,rZr&r[r'zall-tagsa SELECT individual_request_tag, spend_date, log_count, total_spend FROM "DailyTagSpend" WHERE spend_date >= $1::date AND spend_date <= $2::date ORDER BY total_spend DESC; ap SELECT individual_request_tag, SUM(log_count) AS log_count, SUM(total_spend) AS total_spend FROM "DailyTagSpend" WHERE spend_date >= $1::date AND spend_date <= $2::date AND individual_request_tag = ANY($3::text[]) GROUP BY individual_request_tag ORDER BY total_spend DESC; rr~ log_countc |dSrrnros r2rqz&ui_get_spend_by_tags..J sAaDrsTrrr)namerrr)rCsplitrrRrBr^r_rrrrrrrr)r?r@rr tags_listrVratotal_spend_per_tagtotal_requests_per_tagrtag_name tag_spend sorted_tagsui_tagstag current_spends r2rr s&*IH  1NN3' W>O4PQQHZ 48Z9=T  '))33       '))33       4?3J3J53Q6A6M6Mc6R/0 & H%2%x(C ,<<( ,224.RVWKGA  $M5)I!-3MA&3CF;   W %%i $ s%A/E.1E*2(E.E,CE.,E.z/spend/logs/session/uiz+Get all spend logs for a particular session session_idcRKddlm} |ttjdd|i}|j j j|ddi d{}|S7#t$r;}t|tr|ttjt|d}~wwxYww) z5 Get all spend logs for a particular session rrNzDatabase not connectedr'rr ascr9) r+rrrrUr^rr!r,rRr/)rrXrr'rFr1s r2ui_view_session_spend_logsr\ s$9  "AA/  )*5$''99CC";*>D      a 'G"AA1v  s;B'A A AA B'A B$)6BB$$B'c8|iS|dk(r ddddiiddigiSdd|iiS)a Helper function to build the status filter condition for database queries. Args: status_filter (Optional[str]): The status to filter by. Can be "success" or "failure". Returns: Dict[str, Any]: A dictionary containing the status filter condition. NrSORrequalsrn)rs r2rr sF  !8Y"788T:JKLL8]344rs)r)N)NN)Prrirrr functoolsrtypingrrr r r r fastapir rrrrlitellm._loggingrrgrr$litellm.proxy.auth.user_api_key_authr1litellm.proxy.spend_tracking.spend_tracking_utilsrrhrr+rrouterrr3Queryr/r;LiteLLM_SpendLogsrWUserAPIKeyAuthrcrrrrrrrrrrpostSpendCalculateRequestrrrr*r6rfrQrXrqrtr|rrrrrGlobalEndUsersSpendrrrrrBrrrrnrsr2rsa 22DD==1"UB:7L  # $+,-      : # $+,-  +W]]4- c]-  - ` # $+,- gt-. /  !. @!,gmm7 F  F sm F F R%3;GO: # $+,- gt-. / !. <!,gmm3)00A(Be  e sm e &e e P%3;GO< # $+,- gt-. / !. <!,gmm3)00A(BP  P sm P &P P f, # $+,- gt-. / %w}}+!. <!,gmm3M M  M smM M `! # $+,- gt-. / %w}}+!. <!,gmm3` `  ` sm` ` F # $+,- gt-. /  !. <!,gmm3)00A(Bw  w sm w &w w t # $+,- gt-. /  !. <!,gmm3BOIB+W]]Q'4gmm`'+W]]N"/I"3Z  Z sm Z w<=>Z c]Z "sm#Z *c]+Z 2#3Z Z z ! # $+,- gt-. /  ( ( V # $+,- gt-. /  !. @!,gmm7('--8G  G sm G  3-G G T1 1 1 h # $+,- 4   G #8G  G T # $+,- gt-. /  +W]]5+W]]5!. J!+W]]2"/P""/M"!. @!,gmm7 ;#W]] :qS)00A(B#07=="R$)7=="8WX+ c]X+ c] X+ X+c]X+"#X+*+X+2 3X+:sm;X+B CX+HIX+N&OX+PC=QX+V C=WX+X+v 3! # $+,-  !. @!,gmm7 (( ( sm ( (V # $+,- gt-. /  +W]]5+W]]5!. A!!. @!,gmm7$gmmt)00A(B3f c]f c] f  f  f "sm#f *+f 2&3f f R # $+,-    @ # $+,-   H  HX"(/0A(B# c]#%#L # $+,-  +W]]c)00A(B R c]R & R  R j # $+,-   '  ' V57+%+.1+\ # $+,-  F)00A(B ) ) & )  )X # $+,-   T  Tn # $+,-   %  %4 # $+,-   ,x0C'D,  ,`57%.1B # $+,-  J)00A(B   &   B 0FGW+ 6W+HW+v<@(-1" W&W&W&L)W&sm W&t # $+,- gt-. /  $gmmA)00A(B  &  F5(3-5DcN5rs