NgdZddlZddlZddlmZmZmZmZmZm Z ddl Z ddl m Z ddl mZddlmZGddZGd d eZdS) ah Pathway Vector Store client. The Pathway Vector Server is a pipeline written in the Pathway framweork which indexes all files in a given folder, embeds them, and builds a vector index. The pipeline reacts to changes in source files, automatically updating appropriate index entries. The PathwayVectorClient implements the LangChain VectorStore interface and queries the PathwayVectorServer to retrieve up-to-date documents. You can use the client with managed instances of Pathway Vector Store, or run your own instance as described at https://pathway.com/developers/user-guide/llm-xpack/vectorstore_pipeline/ N)AnyCallableIterableListOptionalTupleDocument) Embeddings) VectorStorec eZdZ ddeedeedeefdZ ddeded eed eefd Z e Z d efd Z dd eed eed e fdZ dS)_VectorStoreClientNhostporturlcd}||s|rt|||_dS|t||pd}d|d||_dS)av A client you can use to query :py:class:`VectorStoreServer`. Please provide aither the `url`, or `host` and `port`. Args: - host: host on which `:py:class:`VectorStoreServer` listens - port: port on which `:py:class:`VectorStoreServer` listens - url: url at which `:py:class:`VectorStoreServer` listens zCEither (`host` and `port`) or `url` must be provided, but not both.NPzhttp://:) ValueErrorr)selfrrrerrs d/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/vectorstores/pathway.py__init__z_VectorStoreClient.__init__sj T ? &t & oo%DHHH| oo%:2D.....DHHHquerykmetadata_filterreturnc||d}|||d<|jdz}tj|tj|ddid}|}t |d S) av Perform a query to the vector store and fetch results. Args: - query: - k: number of documents to be returned - metadata_filter: optional string representing the metadata filtering query in the JMESPath format. The search will happen only for documents satisfying this filtering. )rrNrz /v1/retrieve Content-Typeapplication/jsonr)dataheaderstimeoutc|dS)Ndist)xs rz*_VectorStoreClient.query..Rs qyr)key)rrequestspostjsondumpssorted)rrrrr#rresponse responsess rrz_VectorStoreClient.query9sQ''  &&5D" #h'= D!!#%78     MMOO i%8%89999rct|jdz}tj|iddi}|}|S)z.Fetch basic statistics about the vector store.z/v1/statisticsr!r"r.r$rr,r-r.)rrr1r2s rget_vectorstore_statisticsz-_VectorStoreClient.get_vectorstore_statisticsWsKh))= #%78    MMOO rfilepath_globpatterncz|jdz}tj|||dddi}|}|S)a Fetch information on documents in the vector store. Args: metadata_filter: optional string representing the metadata filtering query in the JMESPath format. The search will happen only for documents satisfying this filtering. filepath_globpattern: optional glob pattern specifying which documents will be searched for this query. z /v1/inputs)rr7r!r"r4r5)rrr7rr1r2s rget_input_filesz"_VectorStoreClient.get_input_filescsYh%= #2(<$%78    MMOO rNNN)rNNN)__name__ __module__ __qualname__rstrintrrdictr__call__r6listr9r(rrrrs#"! //sm/sm/c] ////8HL::: :7?}: d::::8H D    *..2!#'sm  rrc eZdZdZ ddeedeedeeddfdZ ddeed ee e d e de efd Z e dde ed ed ee e d e ddf d Z ddeded e de efdZ ddededeede eeeffdZdeegeffdZde fdZ ddeedeedefdZdS)PathwayVectorClientz9 VectorStore connecting to Pathway Vector Store. Nrrrrc2t||||_dS)aO A client you can use to query Pathway Vector Store. Please provide aither the `url`, or `host` and `port`. Args: - host: host on which Pathway Vector Store listens - port: port on which Pathway Vector Store listens - url: url at which Pathway Vector Store listens N)rclient)rrrrs rrzPathwayVectorClient.__init__s )tS99 rtexts metadataskwargsc td)z(Pathway is not suitable for this method.zKPathway vector store does not support adding or removing texts from client.NotImplementedError)rrHrIrJs r add_textszPathwayVectorClient.add_textss"    r embeddingc td)Nz>Pathway vector store does not support initializing from_texts.rL)clsrHrOrIrJs r from_textszPathwayVectorClient.from_textss" L   rrrc |dd}|rtjd|||||}d|DS)NrzBUnknown kwargs passed to PathwayVectorClient.similarity_search: %srrrcHg|]}t|d|d S)textmetadata page_contentrXr .0rets r z9PathwayVectorClient.similarity_search..s:   MPH#f+J H H H   r)poploggingwarningrG)rrrrJrretss rsimilarity_searchz%PathwayVectorClient.similarity_searchst!**%6==   OT   {{!_{MM  TX    rrcJ||||}d|DS)a(Run similarity search with Pathway with distance. Args: - query (str): Query text to search for. - k (int): Number of results to return. Defaults to 4. - metadata_filter (Optional[str]): Filter by metadata. Filtering query should be in JMESPath format. Defaults to None. Returns: List[Tuple[Document, float]]: List of documents most similar to the query text and cosine distance in float for each. Lower score represents more similarity. rUcXg|]'}t|d|d|df(S)rWrXrYr'r r[s rr^zDPathwayVectorClient.similarity_search_with_score..sF   3v;Z I I I3v; W   r)rG)rrrrrbs rsimilarity_search_with_scorez0PathwayVectorClient.similarity_search_with_scores<&{{!_{MM      rc|jSN)_cosine_relevance_score_fnrs r_select_relevance_score_fnz.PathwayVectorClient._select_relevance_score_fns ..rc4|jS)z.Fetch basic statistics about the Vector Store.)rGr6rjs rr6z.PathwayVectorClient.get_vectorstore_statisticss{55777rr7c8|j||S)z'List files indexed by the Vector Store.)rGr9)rrr7s rr9z#PathwayVectorClient.get_input_filess {**?__doc__rr?r@rrrrArrN classmethodr rRr rcrfloatrfrrkr6rCr9r(rrrErEs[ #"! ::sm:sm:c] :  ::::*+/   }  DJ'    c      +/   Cy    DJ'        [  $%        03  h     $)-      "#  eHeO$ %     4/HeWe^,D////8D8888 *..2RR!#R'smR  RRRRRRrrE)rnr.r`typingrrrrrrr,langchain_core.documentsr langchain_core.embeddingsr langchain_core.vectorstoresr rrEr(rrrus   AAAAAAAAAAAAAAAA------000000333333 ________DeReReReReR+eReReReReRr