h ddlmZmZmZmZddlmZmZmZm Z ddl Z ddl m Z ddl mZddlmZddlmZddlmZmZdd lmZdd lmZmZeZed d g ZdeeeffdZej?deeegdZ ejCdd geegde fdZ"deee#ffdZ$ej?deegdZ%ejCdd geegdZ&y))AnyDictListTuple) APIRouterDepends HTTPExceptionRequestN)verbose_proxy_logger) RedisCache) safe_dumps)SensitiveDataMasker)ProxyErrorTypesProxyException)user_api_key_auth)CachePingResponseHealthCheckCacheParamsz/cachecaching)prefixtagsreturncPtjiS ttjj}|rtdi|j ni}t j |S#ttf$r-}tjdt|icYd}~Sd}~wwxYw)a Safely extracts and cleans cache parameters. The health check UI needs to display specific cache parameters, to show users how they set up their cache. eg. { "host": "localhost", "port": 6379, "redis_kwargs": {"db": 0}, "namespace": "test", } Returns: Dict containing cleaned and masked cache parameters NzError extracting cache params: ) litellmcachevarsr model_dumpmasker mask_dictAttributeError TypeErrorr debugstr) cache_paramscleaned_paramses X/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/proxy/caching_routes.py_extract_cache_paramsr(s"}} GMM//0 CO " 2\ 2 = = ?UW // I &""%DSVH#MN sAA))B%8"B B% B%z/ping)response_model dependenciesc Ki}i} tj tddtj t tj}|j ddt}tjjdk(rtjjd{}tjdt|ztjjdd d d d g d{tjdtdttjjddt||Stdttjjt|S77#t $rc}ddl}dt|dt|t||j%d}t't|t(j*ddd}~wwxYww)z6 Endpoint for checking if cache can be pinged N,Cache not initialized. litellm.cache is None status_codedetailrredisz/cache/ping: ping_response: test_keyz test-modeluserztest from litellm)rolecontent)resultmodelmessagesz"/cache/ping: done with set_cache()healthyTsuccess)status cache_type ping_responseset_cache_responselitellm_cache_paramshealth_check_cache_params)r;r<r?rService Unhealthy ())messager?r@ traceback cache_ping)rCtypeparamcode)rrr rrrpopr(rFpingr r"r#async_add_cacherr ExceptionrD format_excrrcache_ping_error)r?cleaned_cache_paramsr=r&rD error_messages r'rErE4s,.+-3 == (V  &//W]]0CD  $/46 ==   (")--"4"4"66M & &.]1CC --//!"#)6IJK0   ! & &'K L$ w}}112"#,%/0D%E*>  % w}}112%/0D%E +7  *  -SVHA6$./C$D)34H)I"--/  }- 11    s\G:B#F +F,AF :F ;AF G:7F G:F F G7AG22G77G:z/delete)rr*requestcK tj tdd|jd{}|j dd}tjj dk(r,tjj |d{dd iStd d tjj d 773#t$r}td d t|dd}~wwxYww)a Endpoint for deleting a key from the cache. All responses from litellm proxy have `x-litellm-cache-key` in the headers Parameters: - **keys**: *Optional[List[str]]* - A list of keys to delete from the cache. Example {"keys": ["key1", "key2"]} ```shell curl -X POST "http://0.0.0.0:4000/cache/delete" -H "Authorization: Bearer sk-1234" -d '{"keys": ["key1", "key2"]}' ``` Nr,r-r.keysr1)rSr;r: Cache type z; does not support deleting a key. only `redis` is supportedzCache Delete Failed(rB) rrr jsongetrFdelete_cache_keysrLr#)rQ request_datarSr&s r' cache_deleterZus& == (V %\\^+ - ==   (--11t1< < <)  $W]]%7%7$88st , =  )#a&3   sKC,0CB=AC B? CC,*C?C C) C$$C))C,c |j}|t|fS#t$r0}tjdt |dgdfcYd}~Sd}~wwxYw)z Helper function to safely get Redis client list information. Returns: tuple: (client_list, num_clients) where num_clients is -1 if CLIENT LIST is unavailable zACLIENT LIST command failed (likely restricted on managed Redis): z8CLIENT LIST command not available on this Redis instanceN) client_listlenrLr warningr#)cache_instancer]r&s r'_get_redis_client_inforashP$002 C ,,, P$$OPSTUPVx X KKROO Ps A%A AAz /redis/info)r*c K tj tddtjjdk(r(t tjjt s)tddtjjdt tjj\}}tjjj}|||d S#t$r}tdd t|d d}~wwxYww) z* Endpoint for getting /redis/info Nr,r-r.r1rTrUz does not support redis info) num_clientsclientsinforArB) rrr rF isinstancer rarerLr#)r]rc redis_infor&s r'cache_redis_inforhs == (V  MM  ' )7==.. ;$W]]%7%7$88TU  $:'--:M:M#N []]((--/ '"   (Q2   s)DCC#"D# D ,DD  Dz /flushallcK tj tddtjjdk(rTt tjjt r,tjjj ddiStdd tjjd #t$r}tdd t|d d}~wwxYww) a A function to flush all items from the cache. (All items will be deleted from the cache with this) Raises HTTPException if the cache is not initialized or if the cache type does not support flushing. Returns a dictionary with the status of the operation. Usage: ``` curl -X POST http://0.0.0.0:4000/cache/flushall -H "Authorization: Bearer sk-1234" ``` Nr,r-r.r1r;r:rTrUz does not support flushingrArB) rrr rFrfr flushallrLr#)r&s r'cache_flushallrks  == (V  ==   (Z MM  .  MM   ( ( *)  $W]]%7%7$88RS   (Q2   s/C&B B;C&)B;; C#CC##C&)'typingrrrrfastapirrr r rlitellm._loggingr litellm.caching.cachingr *litellm.litellm_core_utils.safe_json_dumpsr 0litellm.litellm_core_utils.sensitive_data_maskerrlitellm.proxy._typesrr$litellm.proxy.auth.user_api_key_authrlitellm.types.cachingrrrrouterr#r(rWrEpostrZintrarhrkrr'rysI))>>1.AP@BK       tCH~< $+,-  9  9 x +,-  % %  % PPeD#I.>P"+,- " " J +,-     rx