NgX2ddlZddlZddlmZmZmZmZmZmZm Z ddl Z ddl m Z ddl mZddlmZddlmZmZddlmZdZejGd d Zd eefd Z ddedededed eeeeeefff dZGddeZdS)N)AnyDictListMappingOptionalUnioncast)CallbackManagerForLLMRun)LLM)get_from_dict_or_env) ConfigDictmodel_validator)enforce_stop_tokens<cHeZdZUdZeed<eed<ddZed dZdS) AviaryBackendzAviary backend. Attributes: backend_url: The URL for the Aviary backend. bearer: The bearer token for the Aviary backend. backend_urlbearerreturnNc"d|ji|_dS)N Authorization)rheaderselfs [/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/llms/aviary.py __post_init__zAviaryBackend.__post_init__s& 4 ctjd}|s Jdtjdd}|rd|nd}||dsdndz }|||S)N AVIARY_URLzAVIARY_URL must be set AVIARY_TOKENzBearer /)osgetenvendswith)cls aviary_url aviary_tokenrs rfrom_envzAviaryBackend.from_envsY|,, 333333y44 -9A)<)))r!4!4S!9!9AccrA s:v&&&r)rN)rr) __name__ __module__ __qualname____doc__str__annotations__r classmethodr)rrrrsk KKK5555 ' ' '[ ' ' 'rrrctt}|jdz}tj||jt } |}n2#tj$r }td|d|j |d}~wwxYwtd| D}|S)zList available modelsz-/routes)headerstimeoutError decoding JSON from . Text response: Nchg|]/}d|v|ddd0S)--r")lstripreplace).0ks r zget_models..8s7NNNaDAII#  tS ) )IIIr) rr)rrequestsgetrTIMEOUTjsonJSONDecodeError RuntimeErrortextsortedkeys)backend request_urlresponseresultes r get_modelsrL,s$$&&G% 2K|KQQQH  # U U Uhm U U   NN6;;==NNNF MsAB *BB Tr!modelpromptuse_prompt_formatversioncZt}|j|ddzdz|zdz}t j||j||dt} |S#tj $r }td|d|j |d}~wwxYw) z#Get completions from Aviary models.r"r8query)rNrO)r3rAr4r5r6N) rr)rr:r>postrr@rArBrCrD)rMrNrOrPrGurlrIrKs rget_completionsrU=s$$&&G   c4 8 8 83 > H7 RC} 5F G G H }}  # M M Mhm M M   s'A;;B* B%%B*c heZdZUdZdZeed<dZeeed<dZ eeed<dZ e ed<dZ eeed <e d Zed ededefdZedeeeffdZedefdZ ddedeeedeededef dZdS)AviaryabAviary hosted models. Aviary is a backend for hosted models. You can find out more about aviary at http://github.com/ray-project/aviary To get a list of the models supported on an aviary, follow the instructions on the website to install the aviary CLI and then use: `aviary models` AVIARY_URL and AVIARY_TOKEN environment variables must be set. Attributes: model: The name of the model to use. Defaults to "amazon/LightGPT". aviary_url: The URL for the Aviary backend. Defaults to None. aviary_token: The bearer token for the Aviary backend. Defaults to None. use_prompt_format: If True, the prompt template for the model will be ignored. Defaults to True. version: API version to use for Aviary. Defaults to None. Example: .. code-block:: python from langchain_community.llms import Aviary os.environ["AVIARY_URL"] = "" os.environ["AVIARY_TOKEN"] = "" light = Aviary(model='amazon/LightGPT') output = light('How do you make fried rice?') zamazon/LightGPTrMNr'r(TrOrPforbid)extrabefore)modevaluesrcht|dd}t|dd}|tjd<|tjd< t}n+#tjj$r}t|d}~wwxYw|d}|r||vrt|d|dd|S) z?Validate that api key and python package exists in environment.r'rr(r NrMz does not support model .) r r#environrLr> exceptionsRequestException ValueErrorr?)r&r\r'r( aviary_modelsrKrMs rvalidate_environmentzAviary.validate_environments*&, MM +FNNSS $. < %1 >" &LLMM"3   Q--   7##  XU-// VVF7OVVVWW W sAA9%A44A9c |j|jdS)zGet the identifying parameters.) model_namer')rMr'rs r_identifying_paramszAviary._identifying_paramss*/   rc>d|jddS)zReturn type of llm.zaviary-r"-)rMr:rs r _llm_typezAviary._llm_types$8++C55777rrNstop run_managerkwargsc d|ji}|jr |j|d<td|j|d|}t t |d}|rt ||}|S)a Call out to Aviary Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. Example: .. code-block:: python response = aviary("Tell me a joke.") rOrP)rMrNgenerated_textr1)rOrPrUrMr r.r)rrNrkrlrmoutputrDs r_callz Aviary._calls&&t'=> < - $ F9   *     C 0122  3&tT22D r)NN)r*r+r,r-rMr.r/r'rr(rOboolrPr model_configrr0rrrdpropertyrrgrjrr rqr1rrrWrWUs>#E3""" $J $$$"&L(3-&&&"t"""!GXc]!!!:L_(###$3[$#( WS#X%6   X 83888X8%):> !!!tCy!!67 !  ! !!!!!!rrW)Tr!) dataclassesr#typingrrrrrrr r>langchain_core.callbacksr #langchain_core.language_models.llmsr langchain_core.utilsr pydanticr rlangchain_community.llms.utilsrr@ dataclassrr.rLrrfloatintrUrWr1rrrs BBBBBBBBBBBBBBBBBB======33333355555500000000>>>>>>  ''''''''6DI(#      #uS%_% %& 0pppppSpppppr