Ng>ddlZddlZddlmZmZmZmZmZmZddl Z ddl m Z ddl m Z ddlmZddlmZejeZGdde ZdS) N)AnyDictListMappingOptionalSet)CallbackManagerForLLMRun)LLM)Field)enforce_stop_tokensc ReZdZUdZdZeed< eddZe ed< dZ e e ed < d Z e e ed < d Ze e ed < dZeed< dZe eed< gZe eeed< dZe e ed< dZe e ed< dZeed< gZeeed< dZeed< deddffd ZedefdZedeefdZde eeffdZ!ede"eeffd Z# d$d!ede eed"e e$dedef d#Z%xZ&S)%Yuan2unYuan2.0 language models. Example: .. code-block:: python yuan_llm = Yuan2( infer_api="http://127.0.0.1:8000/yuan", max_tokens=1024, temp=1.0, top_p=0.9, top_k=40, ) print(yuan_llm) print(yuan_llm.invoke("你是谁？")) zhttp://127.0.0.1:8000/yuan infer_apii max_token)alias max_tokensgffffff?tempg?top_prtop_kF do_sampleechostop@ repeat_last_ngzG?repeat_penalty streaminghistory use_historykwargsreturnNc tjdi||jpddkr0|jpddkr%tdd|_dSdSdS)zInitialize the Yuan2 class.rzGtop_p and top_k cannot be set simultaneously. set top_k to 0 instead...N)super__init__rrloggerwarning)selfr __class__s Z/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/llms/yuan2.pyr$zYuan2.__init__Isw""6""" JO!q djoA%:%: NN,   DJJJ ! %:%:cdS)NzYuan2.0r"r's r) _llm_typezYuan2._llm_typeTsyr*c hdS)N>rrrrrr"r"r*r)_model_param_nameszYuan2._model_param_namesXs    r*c h|j|j|j|j|j|j|j|jdS)Nrrrrrrrrr1r,s r)_default_paramszYuan2._default_paramsbs;/"1IZZ+   r*cdjifdjDS)zGet the identifying parameters.modelcHi|]\}}|v||Sr")r/).0kvr's r) z-Yuan2._identifying_params..ts<A!t?V?V?X?X:X:X1:X:X:Xr*)r-r2__dict__itemsr,s`r)_identifying_paramszYuan2._identifying_paramsnsc T^ ""$$ !%!4!4!6!6  r*prompt run_managerc |jr5|j|d|j}n|}ddi}t jd|dg|j|j|j|j |j d}t d| tj|j||}n.#tjj$r} t%d | d } ~ wwxYwt d ||jd krt%d | |} | ddkr"t%d| dd| ddd| vrIt)| dddkr| dddd} nt%dt%dn6#tjj$r} t%d| d|jd } ~ wwxYw|t/| |} |jr|j| t d|j| S)uxCall out to a Yuan2.0 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = yuan_llm.invoke("你能做什么?") zz Content-Typezapplication/json000)idques) ques_listtokens_to_generate temperaturerrrzYuan2.0 prompt:)headersdatazError raised by inference api: NzYuan2.0 response: zFailed with response: errCode0zFailed with error code [z], error message: [ exceptionMsg]resDataoutputranszNo output found in response.zNo resData found in response.z:Error raised during decoding response from inference api: z . Response: z history: )rrappendjoinjsondumpsrrrrrr%debugrequestsputr exceptionsRequestException ValueError status_codelenJSONDecodeErrortextr ) r'r=rr>rinputrFrGresponseeresp generate_texts r)_callz Yuan2._callys,    L   ' ' 'JJt|,,EEE!#56z%*E::;&*o#y!^        &... D|DNG$OOOHH"3 D D DBqBBCC C D  4(44555  3 & &@h@@AA A ==??DI#%% ?tI??'+N';??? D  tIx011Q66$(OH$=a$@$GMM$%CDDD !@AAA " "2   /Q//'}//    / tDDM   / L   . . . ///000s1B44CCCBF<<G/G**G/)NN)'__name__ __module__ __qualname____doc__rstr__annotations__r rintrrfloatrrrboolrrrrrrrrrr$propertyr- staticmethodrr/rr2rr<r rc __classcell__)r(s@r)rrs 2Is111eD 444J444D(5/. E8E?   .E8C=.It!D(4.   % "D(49 """@#%M8C=%%%&*NHUO***2It/GT#Y%K'        3X C   \   c3h      WS#X%6   X %):> TTTtCy!T67 T  T TTTTTTTTr*r)rRloggingtypingrrrrrrrUlangchain_core.callbacksr #langchain_core.language_models.llmsr pydanticr langchain_community.llms.utilsr getLoggerrdr%rr"r*r)rws ::::::::::::::::======333333>>>>>>  8 $ $~~~~~C~~~~~r*