Ng8dZddlmZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZddlmZddlZddlmZddlmZmZdd lmZmZdd lmZmZm Z m!Z!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(dd l)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/e rddl0m1Z1m2Z2m3Z3m4Z4ddl5m6Z6ej7e8Z9eGddZ:d+dZ;d,dZd/d$Z?ed%d&d'(Gd)d*e*eZ@dS)0z1Wrapper around Google VertexAI chat-based models.) annotationsN) dataclassfield) TYPE_CHECKINGAnyDictIteratorListOptionalUnioncast)urlparse) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun) BaseChatModelgenerate_from_stream) AIMessageAIMessageChunk BaseMessage HumanMessage SystemMessage)ChatGenerationChatGenerationChunk ChatResult)pre_init)_VertexAICommonis_codey_modelis_gemini_model)load_image_from_gcsraise_vertex_import_error) ChatMessage ChatSessionCodeChatSessionInputOutputTextPair)ContentcDeZdZUdZeeZded<dZded<dS) _ChatHistoryz/Represents a context and a history of messages.)default_factoryzList['ChatMessage']historyN Optional[str]context) __name__ __module__ __qualname____doc__rlistr*__annotations__r,d/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/chat_models/vertexai.pyr(r(6sG99#(5#>#>#>G>>>>!G!!!!!!r4r(r*List[BaseMessage]returncddlm}gd}}t|D]\}}tt|j}|dkrt |tr|}=t |tr(||jd}| |zt |tr(||jd}| |tdt|d|d t|| }|S) aParse a sequence of messages into history. Args: history: The list of messages to re-create the history of the chat. Returns: A parsed chat history. Raises: ValueError: If a sequence of message has a SystemMessage not at the first place. r)r"Nbot)contentauthoruserUnexpected message with type  at the position .)r,r*)vertexai.language_modelsr" enumerater strr: isinstancerrappendr ValueErrortyper() r*r"vertex_messagesr,imessager:vertex_message chat_historys r5_parse_chat_historyrL>s0544444!4WO((   7sGO,, 66j-886GG  + + ([OOON  " "> 2 2 2 2  . . ([PPPN  " "> 2 2 2 2TW TTPQTTT  IIIL r4srBboolc t|}t|j|jgS#t$r(}t d|Yd}~dSd}~wwxYw)NzUnable to parse URL: F)rallschemenetloc Exceptionloggerdebug)rMresultes r5_is_urlrX^sp!FM6=1222  0Q00111uuuuus), AAAprojectr+List['Content']c ddlm}m m d fd g}t |D]\}}|dkr$t |t rtdt |trd }n;t |trd }n#td t|d |d |j }t |tr|g} fd|D}|||} | | |S)Nr)r&ImagePartpartUnion[str, Dict]r7r]ct|tr|St|ts t dt |d|ddkr|dS|ddkr|dd}|drt|}n|d rdtj d |}|r| d }nt d  tj |}nwt|rCtj|}| |j}n%|}nt d |S)Nz0Message's content is expected to be a dict, got !rFtext image_urlurlzgs://)pathrYz data:image/zdata:image/\w{2,4};base64,(.*)zdInvalid image uri. It should be in the format data:image/;base64,.z,Only text and image_url types are supported!)rCrB from_textrrErF startswithr researchgroup from_bytesbase64 b64decoderXrequestsgetraise_for_statusr:load_from_file from_image)r^reimageencodedresponser\r]rYs r5_convert_to_promptz6_parse_chat_history_gemini.._convert_to_promptls dC  (>>$'' '$%% P4::PPP  <6 ! !>>$v,// / &\[ ( ( $U+Dw'' 3+wGGG// 3!y)JDQQ%mmA..GG$Q(()9')B)BCC 3#<--))+++(()9::,,T22KLL Lu%%%r4z%SystemMessages are not yet supported!modelr<r=r>r?c&g|] }|Sr3r3).0r^rws r5 z._parse_chat_history_gemini..s%BBBd##D))BBBr4)roleparts)r^r_r7r])"vertexai.preview.generative_modelsr&r\r]rArCrrErrrFr:rBrD) r*rYr&rGrHrIr| raw_contentr}rJr\r]rws ` @@@r5_parse_chat_history_geminirgseHGGGGGGGGG!&!&!&!&!&!&!&!&FO((// 7 66j-886DEE E  + + DD  . . DDTW TTPQTTT o k3 ' ' (&-KBBBBkBBB d%888~.... r4examplesList['InputOutputTextPair']cddlm}t|dzdkr tdt|dg}d}t |D]\}}|dzdkr?t |t s#tdt|d|d|j}|dzd kr_t |ts#td t|d|d|||j }| ||S) Nr)r%z8Expect examples to have an even amount of messages, got r?z;Expected the first message in a part to be from human, got z for the z th message.rfz9Expected the second message in a part to be from AI, got ) input_text output_text) r@r%lenrErArCrrFr:rrD)rr% example_pairsrrHexamplepairs r5_parse_examplesrss<<<<<< 8}}qA Ws8}} W W W   MJ))'' 7 q5A::g|44  >G}}>>/0>>>!J q5A::gy11  >G}}>>/0>>>'&%7?D   & & & r4messagesrc|std|d}t|tstd|jd|S)zMGet the human message at the end of a list of input messages to a chat model.z:You should provide at least one message to start the chat!z3Last message in the list should be from human, got r?)rErCrrF)rquestions r5 _get_questionrs^ WUVVV|H h - -  R(- R R R    Or4z0.0.12z1.0z&langchain_google_vertexai.ChatVertexAI)sinceremovalalternative_importceZdZUdZdZded< dZded<ed$d Zed%d Z e d&dZ d'd(dZ d)d*dZ d)d+dZd,d#ZdS)- ChatVertexAIz+`Vertex AI` Chat large language models API.z chat-bisonrB model_nameNzOptional[List[BaseMessage]]rr7rNcdS)NTr3)selfs r5is_lc_serializablezChatVertexAI.is_lc_serializablestr4 List[str]c gdS)z*Get the namespace of the langchain object.) langchain chat_modelsvertexair3)clss r5get_lc_namespacezChatVertexAI.get_lc_namespaces8777r4valuesrcZt|d}|| ddlm}m}|rddlm}n#t$rtYnwxYw|r||d|d<n8t|dr|}n|}| |d|d<|S)z7Validate that the python package exists in environment.rr) ChatModel CodeChatModel)GenerativeModel)rclient) r_try_init_vertexair@rrr~r ImportErrorr!rfrom_pretrained)rr is_geminirrr model_clss r5validate_environmentz!ChatVertexAI.validate_environments$F<$899  v&&& ( I I I I I I I I  ( ( ( % ' ' ' ' ' (  O.&:NOOOF8  f\233 &) % (88 9MNNF8  s=AArr6stopOptional[List[str]] run_manager"Optional[CallbackManagerForLLMRun]streamOptional[bool]kwargsrrc ||n|j}|r |j|f||d|}t|St|}|jd |dd|} i} d| vr| d| d<|jr]t||j} | } |j | } | | | }nht|dd }| d p|j}|rt|| d <|j|fi| } | j |jfi| }d |jD}t'| S)a>Generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. stream: Whether to use the streaming endpoint. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. N)rrFrrcandidate_countrYr*generation_configrrcTg|]%}tt|j&Sr:rIrrrbrzrs r5r{z*ChatVertexAI._generate..,@    9QV#<#<#< = = =   r4 generationsr3) streaming_streamrr_prepare_paramspop_is_gemini_modelrrYr start_chat send_messagerLrprr _start_chatr: candidatesr)rrrrrr should_stream stream_iterrparams msg_paramshistory_geminirIchatrvr*rrs r5 _generatezChatVertexAI._generates.#)"4$.  5&$,#@FK( 44 4 **%%H4HHHH  & &,2JJ7H,I,IJ( )  I7$,WWWN$((**G;)).)AAD((F(KKHH)(3B3-88Gzz*-->H ?%4X%>%>z"#4#G66v66D(t()9HHZHHH  (   k2222r4'Optional[AsyncCallbackManagerForLLMRun]cKd|vr/|dtd|jd d|i|}i}d|vr|d|d<|jrct ||j}|}|j|} | ||d{V} nwt|} t|dd } | d d} | rt| |d <|j| fi|} | j | jfi|d{V} d | jD}t#| S)aAsynchronously generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. rz8ChatVertexAI does not currently support async streaming.rrrrrNrrcTg|]%}tt|j&Srrrs r5r{z+ChatVertexAI._agenerate..^rr4rr3)rrTwarningrrrrYrrsend_message_asyncrrLrprrr:rr)rrrrrrrrrIrrvrr*rrs r5 _ageneratezChatVertexAI._agenerate2s* v   JJx NNU V V V%%::4:6::  & &,2JJ7H,I,IJ( )  U7$,WWWN$((**G;)).)AAD!44WPV4WWWWWWWWHH$X..H)(3B3-88Gzz*d33H ?%4X%>%>z"#4#G66v66D4T4X5ETTTTTTTTTTH  (   k2222r4Iterator[ChatGenerationChunk]c+jK|jd |dd|}|jr^t||j}|}|j|}||d|} nqt|} t|dd} | dd} | rt| |d<|j | fi|}|j | jfi|} | D]G} tt!| j }|r|| j| |VHdS) NTrrr)rrrrrr)chunkr3)rrrrYrrrrrrLrprrsend_message_streamingr:rrrbon_llm_new_token)rrrrrrrrIr responsesrr*rrvrs r5rzChatVertexAI._streamds&%G4GGGG   P7$,WWWN$((**G;)).)AAD))*II%X..H)(3B3-88Gzz*d33H ?%4X%>%>z"#4#G66v66D33H4DOOOOI!  H'x}0U0U0UVVVE I,,X]%,HHHKKKK   r4r*r(#Union[ChatSession, CodeChatSession]c |js|jjd|j|jd|S|jjdd|ji|S)N)r,message_historyrr3)rrrr,r*)rr*rs r5rzChatVertexAI._start_chatsh" U)4;)LR *4;)TT'/TVTT Tr4)r7rN)r7r)rrr7r)NNN) rr6rrrrrrrrr7r)NN) rr6rrrrrrr7r) rr6rrrrrrr7r)r*r(rrr7r)r-r.r/r0rr2r classmethodrrrrrrrrr3r4r5rrs# 65"J"""",0H0000[888[8X4%):>!% 4343434343r%)?C 0303030303j%):> :UUUUUUr4r)r*r6r7r()rMrBr7rN)r*r6rYr+r7rZ)rr6r7r)rr6r7r)Ar0 __future__rrmloggingri dataclassesrrtypingrrrr r r r r urllib.parserrolangchain_core._api.deprecationrlangchain_core.callbacksrr*langchain_core.language_models.chat_modelsrrlangchain_core.messagesrrrrrlangchain_core.outputsrrrlangchain_core.utilsr!langchain_community.llms.vertexairrr&langchain_community.utilities.vertexair r!r@r"r#r$r%r~r& getLoggerr-rTr(rLrXrrrrr3r4r5rsU77""""""  ((((((((RRRRRRRRRRRRRRRRRRRR!!!!!!666666SRRRRRRRRR))))))  ; ;:::::  8 $ $ """"""" "@;;;;|<       ? uUuUuUuUuU?MuUuU  uUuUuUr4