h+LddlZddlmZmZmZmZmZddlmZm Z GddZ y)N)ListDictAnyOptionalUnion)UnauthorizedError NotFoundErrorceZdZddedeefdZdeeeffdZddede e eee fe jffdZ dd ed eee fd eeee fdede eee fe jff d Zdd edede eee fe jffdZ dd eed eedede eee fe jffdZddede e eee fe jffdZ dd ed eee fd eeee fdede eee fe jff dZy)ModelsManagementClientNbase_urlapi_keyc>|jd|_||_y)a Initialize the ModelsManagementClient. Args: base_url (str): The base URL of the LiteLLM proxy server (e.g., "http://localhost:8000") api_key (Optional[str]): API key for authentication. If provided, it will be sent as a Bearer token. /N)rstrip _base_url_api_key)selfr rs W/var/www/Befach/backend/env/lib/python3.12/site-packages/litellm/proxy/client/models.py__init__zModelsManagementClient.__init__s"- returncFi}|jrd|j|d<|S)z Get the headers for API requests, including authorization if api_key is set. Returns: Dict[str, str]: Headers to use for API requests zBearer Authorization)r)rheaderss r _get_headersz#ModelsManagementClient._get_headerss* ==)0'@GO $rreturn_requestc|jd}tjd||j}|r|Stj} |j |j }|j|jdS#tjj$r*}|jjdk(r t|d}~wwxYw)a Get the list of models supported by the server. Args: return_request (bool): If True, returns the prepared request object instead of executing it. Useful for inspection or modification before sending. Returns: Union[List[Dict[str, Any]], requests.Request]: Either a list of model information dictionaries or a prepared request object if return_request is True. Raises: UnauthorizedError: If the request fails with a 401 status code requests.exceptions.RequestException: If the request fails with any other error z/modelsGETrdataNrrequestsRequestrSessionsendprepareraise_for_statusjson exceptions HTTPErrorresponse status_coder rrurlrequestsessionr-es rlistzModelsManagementClient.lists  (""5#t7H7H7JK N""$ ||GOO$56H  % % '==?6* *"",, zz%%,'**  ABC.%CC model_name model_params model_infoc|jd}||d}|r||d<tjd||j|}|r|Stj} |j |j } | j| jS#tjj$r*} | jjdk(r t| d} ~ wwxYw)a Add a new model to the proxy. Args: model_name (str): Name of the model to add model_params (Dict[str, Any]): Parameters for the model (e.g., model type, api_base, api_key) model_info (Optional[Dict[str, Any]]): Additional information about the model return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the response from the server or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code requests.exceptions.RequestException: If the request fails with any other error z /model/new)r6litellm_paramsr8POSTrr*r"Nr#) rr6r7r8rr0r!r1r2r-r3s rnewzModelsManagementClient.new?s0 +%*  !+D ""638I8I8KRVW N""$ ||GOO$56H  % % '==? """,, zz%%,'**  s>BC"8%CC"model_idcN|jd}d|i}tjd||j|}|r|Stj} |j |j }|j|jS#tjj$rt}|jjdk(r t||jjdk(s&d|jjjvr t!|d}~wwxYw) a Delete a model from the proxy. Args: model_id (str): ID of the model to delete (e.g., "2f23364f-4579-4d79-a43a-2d48dd551c2e") return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the response from the server or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code NotFoundError: If the request fails with a 404 status code or indicates the model was not found requests.exceptions.RequestException: If the request fails with any other error z /model/deleteidr;r<r" not foundNrr$r%rr&r'r(r)r*r+r,r-r.r textlowerr ) rr>rr0r!r1r2r-r3s rdeletezModelsManagementClient.deleteps" .h""638I8I8KRVW N""$ ||GOO$56H  % % '==? """,, zz%%,'**zz%%, qzz?T?T?V0V#A&&   s>BD$0A/DD$c||| | td|r0|jd}t|tjsJ|S|j}t|t sJ|D]C}|r$|j dij d|k(s|s,|j d|k(sA|cS|rd|d}n |rd |d}nd }ttjj|tj ) aN Get information about a specific model by its ID or name. Args: model_id (Optional[str]): ID of the model to retrieve model_name (Optional[str]): Name of the model to retrieve return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the model information from the server or a prepared request object if return_request is True Raises: ValueError: If neither model_id nor model_name is provided, or if both are provided UnauthorizedError: If the request fails with a 401 status code NotFoundError: If the model is not found requests.exceptions.RequestException: If the request fails with any other error z6Exactly one of model_id or model_name must be providedT)rr8r@r6zModel with id=z not foundzModel with model_name=z"Unknown error trying to find model)r-) ValueErrorinfo isinstancer$r%rgetr r+r,Response)rr>r6rresultmodelsmodelmsgs rrKzModelsManagementClient.gets*  !39MR\RhUV V YYdY3Ffh&6&67 77M&$'''EUYY|R8<r7r8rr0r!r1r2r-r3s rupdatezModelsManagementClient.updates2 .*  !+D ""638I8I8KRVW N""$ ||GOO$56H  % % '==? """,, zz%%,'**zz%%, qzz?T?T?V0V#A&&   s>BD,8A/D''D,)N)F)NF)NNF)__name__ __module__ __qualname__strrrrrboolrrrr$r%r4r=rFrKrIrSrrr r s    x}   d38n 4E$tCH~:NPXP`P`:`4aJ04$ //38n/T#s(^, /  / tCH~x/// 0 /b$s$D$U4PSUXPX>[c[k[kKkEl$Nhm5   5 :B3-5 `d5 tCH~x/// 05 n4E$tCH~:NPXP`P`:`4aH04$ 2238n2T#s(^, 2  2 tCH~x/// 0 2rr ) r$typingrrrrrr+r r r rYrrr[s338YYr