Ng ddlmZmZmZmZmZddlZddlmZddl m Z ddl m Z ddl mZGddZGd d e ZdS) )AnyDictListMappingOptionalN)CallbackManagerForLLMRun)LLM) ConfigDict)enforce_stop_tokensc veZdZdZededeeefdeeeffdZededefdZ dS) ContentHandlerAmazonAPIGatewayzAdapter to prepare the inputs from Langchain to a format that LLM model expects. It also provides helper function to extract the generated text from the model response.prompt model_kwargsreturnc ||dS)N)inputs parameters)clsrrs g/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/llms/amazon_api_gateway.pytransform_inputz.ContentHandlerAmazonAPIGateway.transform_inputs! ===responsecB|ddS)Nrgenerated_text)json)rrs rtransform_outputz/ContentHandlerAmazonAPIGateway.transform_outputs}}q!"233rN) __name__ __module__ __qualname____doc__ classmethodstrrrrrrrrr r s33 >>(,S#X> c3h>>>[> 44444[444rr c eZdZUdZeed< dZeeed< dZ eeed< e Z e ed< e dZ ed eeeffd Zed efd Z dd ed eeedeeded ef dZdS)AmazonAPIGatewayz6Amazon API Gateway to access LLM models hosted on AWS.api_urlNheadersrcontent_handlerforbid)extrarc>|jpi}i|j|jdd|iS)zGet the identifying parameters.)r&r'r)rr&r')self _model_kwargss r_identifying_paramsz$AmazonAPIGateway._identifying_params3s<)/R  ,4<@@ }-  rcdS)zReturn type of llm.amazon_api_gatewayr)r,s r _llm_typezAmazonAPIGateway._llm_type<s $#rrstop run_managerkwargsc 4|jpi}|j||} tj|j|j|}|j|}n$#t$r} td| d} ~ wwxYw|t||}|S)abCall out to Amazon API Gateway model. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = se("Tell me a joke.") )r'rzError raised by the service: N) rr(rrequestspostr&r'r Exception ValueErrorr ) r,rr2r3r4r-payloadrtexterrors r_callzAmazonAPIGateway._callAs*)/R &66v}MM F}  H '88BBDD F F FDUDDEE E F  &tT22D s;A"" B,A>>B)NN)rrr r!r#__annotations__r'rrrr r(r model_configpropertyrrr.r1rrr=rrrr%r%sG@@ LLL"GXd^"""C#'L(4.'''16T6T6V6VO3VVV :L WS#X%6   X $3$$$X$%):> &&&tCy!&67 &  & &&&&&&rr%)typingrrrrrr6langchain_core.callbacksr#langchain_core.language_models.llmsr pydanticr langchain_community.llms.utilsr r r%rrrrFs55555555555555======333333>>>>>>44444444$JJJJJsJJJJJr