NgdZddlZddlmZddlmZmZmZddlm Z ddl m Z m Z m Z ddlmZdgZeeZGd de e ZdS) z-written under MIT Licence, Michael Feil 2023.N) getLogger)AnyListOptional) Embeddings) BaseModel ConfigDictmodel_validator)SelfInfinityEmbeddingsLocalceZdZUdZeed< dZeeed< dZe ed< dZ eed< d Z eed < d Z e ed < dZeed < eddZeddefdZddZdeddfdZdeedeeefdZdedeefdZdeedeeefdZdedeefdZdS)r aOptimized Infinity embedding models. https://github.com/michaelfeil/infinity This class deploys a local Infinity instance to embed text. The class requires async usage. Infinity is a class to interact with Embedding Models on https://github.com/michaelfeil/infinity Example: .. code-block:: python from langchain_community.embeddings import InfinityEmbeddingsLocal async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) modelNrevision batch_sizeautodevicetorchbackendT model_warmupengineforbid)extraprotected_namespacesafter)modereturnc ddlm}n#t$rtdwxYw||j|j|j|j|j|j|_ |S)z?Validate that api key and python package exists in environment.r)AsyncEmbeddingEnginezrPlease install the `pip install 'infinity_emb[optimum,torch]>=0.0.24'` package to use the InfinityEmbeddingsLocal.)model_name_or_pathrrrrr) infinity_embr ImportErrorrrrrrrr)selfr s i/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/embeddings/infinity_local.pyvalidate_environmentz,InfinityEmbeddingsLocal.validate_environmentBs  9 9 9 9 9 9 9   >   +*#z;]*<      s #cHK|jd{VdS)aQstart the background worker. recommended usage is with the async with statement. async with InfinityEmbeddingsLocal( model="BAAI/bge-small-en-v1.5", revision=None, device="cpu", ) as embedder: embeddings = await engine.aembed_documents(["text1", "text2"]) N)r __aenter__)r$s r%r(z"InfinityEmbeddingsLocal.__aenter__Xs4k$$&&&&&&&&&&&argsc4K|jj|d{VdS)zUstop the background worker, required to free references to the pytorch model.N)r __aexit__)r$r*s r%r,z!InfinityEmbeddingsLocal.__aexit__es2$dk#T**********r)textscpK|jjstd|4d{V|j|d{V\}}dddd{Vn#1d{VswxYwYtdn#|j|d{V\}}|S)zAsync call out to Infinity's embedding endpoint. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. zeStarting Infinity engine on the fly. This is not recommended.Please start the engine before using it.Nz$Stopped infinity engine after usage.)rrunningloggerwarningembed)r$r- embeddings_s r%aembed_documentsz(InfinityEmbeddingsLocal.aembed_documentsjs[{" ; NN;    ? ? ? ? ? ? ? ?&*k&7&7&>&> > > > > > > A ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? NNA B B B B"&+"3"3E":":::::::MJs$A'' A14A1textcNK||gd{V}|dS)zAsync call out to Infinity's embedding endpoint. Args: text: The text to embed. Returns: Embeddings for the text. Nr)r5)r$r6r3s r% aembed_queryz$InfinityEmbeddingsLocal.aembed_querys9 00$88888888 !}r)ctdtj||S)z, This method is async only. zQThis method is async only. Please use the async version `await aembed_documents`.)r0r1asynciorunr5)r$r-s r%embed_documentsz'InfinityEmbeddingsLocal.embed_documentss@  E   {40077888r)ctdtj||S) zMThis method is async only. Please use the async version `await aembed_query`.)r0r1r:r;r8)r$r6s r% embed_queryz#InfinityEmbeddingsLocal.embed_querys> B   {4,,T22333r))rN)__name__ __module__ __qualname____doc__str__annotations__rrrintrrrboolrrr model_configr r r&r(r,rfloatr5r8r<r?rr)r%r r s* JJJG"Hhsm"""5J0FCAGSG%L$/FC*:L _'"""d#"* ' ' ' '+S+T++++ DI$tE{:K. s tE{    9T#Y94U 3D999944U 444444r))rCr:loggingrtypingrrrlangchain_core.embeddingsrpydanticrr r typing_extensionsr __all__r@r0r rr)r%rPs33&&&&&&&&&&000000;;;;;;;;;;"""""" $ % 8  M4M4M4M4M4iM4M4M4M4M4r)