NgddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZddlmZddlmZejeZdd iZd Zd e d efd ZGdde ZdS)N)AnyListOptionalUnion)CallbackManagerForLLMRun)LLM) AIMessage BaseMessageFunctionMessage HumanMessage SystemMessage)Field)enforce_stop_tokensz Content-Typezapplication/jsonmessagereturnc*t|tr d|jd}nrt|tr d|jd}nRt|tr d|jd}n2t|t r d|jd}nt d||S)Nuser)rolecontent assistantsystemfunctionzGot unknown type ) isinstancer rr r r ValueError)r message_dicts ]/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/llms/chatglm3.py_convert_message_to_dictrs'<(( 8 &7?CC GY ' '8 +HH G] + +8 (W_EE G_ - -8 *wGG 6W66777 c eZdZUdZeddZeed<dZeed< dZ e e ed < d Z e ed < d Zeed < dZeed< eeZeeed< dZeed< dZeedfed<eZe ed<edefdZede fdZedefdZdede fdZ d dede eede e!dedef dZ"dS)!ChatGLM3zChatGLM3 LLM service.z chatglm3-6bmodel)defaultalias model_namez)http://127.0.0.1:8000/v1/chat/completions endpoint_urlN model_kwargsi N max_tokensg? temperaturegffffff?top_p)default_factoryprefix_messagesF streaming http_clienttimeoutrcdS)N chat_glm_3)selfs r _llm_typezChatGLM3._llm_type:s|rc^|j|j|j|j|jd}i||jpiS)z,Get the parameters used to invoke the model.)r"r)r(r*stream)r%r)r(r*r-r')r3paramss r_invocation_paramszChatGLM3._invocation_params>sD_+/Zn   7&6T.4"66rcNddl}|jp||jS)Nr)r/)httpxr.Clientr/)r3r:s rclientzChatGLM3.clientJs) E5<< <#E#EErpromptc|j}|jt|gz}|dd|Di|S)N)rmessagesc,g|]}t|Sr2)r).0ms r z)ChatGLM3._get_payload..Us!KKKQ5a88KKKr)r8r,r update)r3r=r7r?s r _get_payloadzChatGLM3._get_payloadPs[('<+G+G+G*HH KK(KKK     rstop run_managerkwargsc ddl}||}td| |j|jt|}n$#|j$r}td|d}~wwxYwtd||j dkrtd| | } t| trDd } | | vr,| | } t| r| dd d } n$td | td | n1#tj$r}td|d|jd}~wwxYw|t#| |} | S)axCall out to a ChatGLM3 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = chatglm_llm.invoke("Who are you?") rNzChatGLM3 payload: )headersjsonz$Error raised by inference endpoint: zChatGLM3 response: zFailed with response: choicesrrzNo content in response : zUnexpected response type: z?Error raised during decoding response from inference endpoint: z . Response: )r:rEloggerdebugr<postr&HEADERS NetworkErrorr status_coderKrdictlenJSONDecodeErrortextr) r3r=rFrGrHr:payloadresponseeparsed_response content_keysrMrWs r_callzChatGLM3._callZs*  ##F++ 3'33444 I{''!7(HH! I I IGAGGHH H I  5855666  3 & &@h@@AA A &mmooO/400 Q( ?22-l;G7||@&qz)4Y?$%R%R%RSSS !Oo!O!OPPP#   /RS//'}//    &tT22D s0'A B*A<<B?A?D??E-E((E-)NN)#__name__ __module__ __qualname____doc__rr%str__annotations__r&r'rrTr(intr)floatr*listr,rr r-boolr.rrDEFAULT_TIMEOUTr/propertyr4r8r<rErr]r2rrr!r!%seMAAAJAAACL#CCC#'L(4.'''1J1K-E50).t)D)D)DOT+&DDD,It/$(KsDy!((("GS""" 3X 7D 7 7 7X 7FFFFXF 34%):> ===tCy!=67 =  = ======rr!)rKloggingtypingrrrrlangchain_core.callbacksr#langchain_core.language_models.llmsrlangchain_core.messagesr r r r r pydanticrlangchain_community.llms.utilsr getLoggerr^rNrQrhrTrr!r2rrrrsM ------------======333333>>>>>>  8 $ $ - . k d    rrrrrsrrrrrr