NgrddlZddlmZmZddlmZddlmZeje Z GddeZ dS)N)AnyOptional)LLM)IpexLLMceZdZdZe ddddddedeedeeded eed e d e fd Z e ddd dedeedeed e d e f dZ e d efdZdS)BigdlLLMzWrapper around the BigdlLLM model Example: .. code-block:: python from langchain_community.llms import BigdlLLM llm = BigdlLLM.from_model_id(model_id="THUDM/chatglm-6b") NT) tokenizer_id load_in_4bitload_in_low_bitmodel_id model_kwargsr r r kwargsreturnc td ddlm}m}ddlm} m} n#t$rtdwxYw|td|std|pi} |p|} | j | fi| } n#t$r| j | fi| } YnwxYw |j |fd d i| }n #t$r|j |fd d i| }YnwxYwd | vrd | D} |d||| | d |S)a5 Construct object from model_id Args: model_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. tokenizer_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. 4BigdlLLM was deprecated. Please use IpexLLM instead.r AutoModelAutoModelForCausalLM AutoTokenizerLlamaTokenizerpCould not import bigdl-llm or transformers. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.Nz`load_in_low_bit` option is not supported in BigdlLLM and is ignored. For more data types support with `load_in_low_bit`, use IpexLLM instead.zBigdlLLM only supports loading in 4-bit mode, i.e. load_in_4bit = True. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.r Ttrust_remote_codec&i|]\}}|dk ||Sr.0kvs ^/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/llms/bigdl_llm.py z*BigdlLLM.from_model_id..]0A!?R:R:R1:R:R:Rr model tokenizerr r) loggerwarningbigdl.llm.transformersrr transformersrr ImportError ValueErrorfrom_pretrained Exceptionitems)clsr r r r r rrrrr _model_kwargs _tokenizer_idr'r&s r! from_model_idzBigdlLLM.from_model_ids=2 MNNN          C B B B B B B B B   W    & NN(     W  %* $0  W5 5mUU}UUII W W W66}VV VVIII W 8(8'+/<EE   -I-'+/<EEE  - / /!.!4!4!6!6Ms &       s--ABB*)B*.B??CC)r c td ddlm}m}ddlm}m}n#t$rtdwxYw|pi} |p|} |j | fi| } n#t$r|j | fi| } YnwxYw |j |fi| } n#t$r|j |fi| } YnwxYwd| vrd| D} |d || | | d|S) a Construct low_bit object from model_id Args: model_id: Path for the bigdl-llm transformers low-bit model folder. tokenizer_id: Path for the huggingface repo id or local model folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. rrrrrrc&i|]\}}|dk ||Srrrs r!r"z2BigdlLLM.from_model_id_low_bit..r#r$r%r) r(r)r*rrr+rrr,r.r/ load_low_bitr0) r1r r r rrrrrr2r3r'r&s r!from_model_id_low_bitzBigdlLLM.from_model_id_low_bitis0 MNNN          C B B B B B B B B   W   %* $0  W5 5mUU}UUII W W W66}VV VVIII W F5(5hPP-PPEE F F F*I*8EE}EEEEE F - / /!.!4!4!6!6Ms &       s--AA""A=<A=BB+*B+cdS)Nz bigdl-llmr)selfs r! _llm_typezBigdlLLM._llm_types{r$)N)__name__ __module__ __qualname____doc__ classmethodstrrdictboolrrr4r8propertyr;rr$r!rr sU(,Q '+!)-Q Q Q Q tnQ sm Q  Q "#Q Q  Q Q Q [Q f(,> '+ > > > > tn> sm >  >  > > > [> @3Xr$r) loggingtypingrr#langchain_core.language_models.llmsr!langchain_community.llms.ipex_llmr getLoggerr<r(rrr$r!rJs 333333555555  8 $ $aaaaawaaaaar$