NgFdZddlmZmZmZddlmZGddeZdS)z+Wrapper around Xinference embedding models.)AnyListOptional) EmbeddingsceZdZUdZeed<eeed< eeed< d deedeeffd Zde ede e e fd Z d ede e fd Z xZ S) XinferenceEmbeddingsaqXinference embedding models. To use, you should have the xinference library installed: .. code-block:: bash pip install xinference If you're simply using the services provided by Xinference, you can utilize the xinference_client package: .. code-block:: bash pip install xinference_client Check out: https://github.com/xorbitsai/inference To run, you need to start a Xinference supervisor on one server and Xinference workers on the other servers. Example: To start a local instance of Xinference, run .. code-block:: bash $ xinference You can also deploy Xinference in a distributed cluster. Here are the steps: Starting the supervisor: .. code-block:: bash $ xinference-supervisor If you're simply using the services provided by Xinference, you can utilize the xinference_client package: .. code-block:: bash pip install xinference_client Starting the worker: .. code-block:: bash $ xinference-worker Then, launch a model using command line interface (CLI). Example: .. code-block:: bash $ xinference launch -n orca -s 3 -q q4_0 It will return a model UID. Then you can use Xinference Embedding with LangChain. Example: .. code-block:: python from langchain_community.embeddings import XinferenceEmbeddings xinference = XinferenceEmbeddings( server_url="http://0.0.0.0:9997", model_uid = {model_uid} # replace model_uid with the model UID return from launching the model ) client server_url model_uidNcL ddlm}n:#t$r- ddlm}n"#t$r}td|d}~wwxYwYnwxYwt |t d|t d||_||_|||_ dS)Nr) RESTfulClientzCould not import RESTfulClient from xinference. Please install it with `pip install xinference` or `pip install xinference_client`.zPlease provide server URLzPlease provide the model UID) xinference.clientr ImportErrorxinference_clientsuper__init__ ValueErrorr r r )selfr r r e __class__s e/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/embeddings/xinference.pyrzXinferenceEmbeddings.__init__Rs  7 7 7 7 7 7 7    ;;;;;;;   !Y <;    899 9  ;<< <$"#mJ// s) AA ;6;AAtextsreturncv|j|jfd|D}d|DS)zEmbed a list of documents using Xinference. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. c^g|])}|ddd*S)datar embedding)create_embedding).0textmodels r z8XinferenceEmbeddings.embed_documents..xsC   EIE " "4 ( ( 0 3K @   cRg|]$}ttt|%S)listmapfloat)rrs rr"z8XinferenceEmbeddings.embed_documents..{s(888S]]##888r#)r get_modelr )rr embeddingsr!s @rembed_documentsz$XinferenceEmbeddings.embed_documentsnsZ %%dn55    MR   98Z8888r#r c|j|j}||}|ddd}t t t |S)zEmbed a query of documents using Xinference. Args: text: The text to embed. Returns: Embeddings for the text. rrr)r r)r rr&r'r()rr r! embedding_resrs r embed_queryz XinferenceEmbeddings.embed_query}sZ %%dn55..t44 !&)!,[9 Cy))***r#)NN)__name__ __module__ __qualname____doc__r__annotations__rstrrrr(r+r. __classcell__)rs@rrrsAAF KKK &}#LP00"3-0;CC=0000008 9T#Y 94U 3D 9 9 9 9++U ++++++++r#rN)r2typingrrrlangchain_core.embeddingsrrr%r#rr8sy11&&&&&&&&&&000000C+C+C+C+C+:C+C+C+C+C+r#