Ng8ddlmZddlZddlZddlmZmZmZmZddl m Z ddl m Z ddl mZejeZGddeZdS) ) annotationsN)AnyListOptionalTuple)Document) Embeddings) VectorStoreceZdZdZd?d Z d@dAdZdBdZdCdDdZedEdZ dFdGd%Z dHdId.Z dJdKd0Z dLd1Z e dMdNd2ZdOd3ZdPd5ZdQd6ZdOd7ZdOd8ZdRd:ZdSd>ZdS)TJaguara'`Jaguar API` vector store. See http://www.jaguardb.com See http://github.com/fserv/jaguar-sdk Example: .. code-block:: python from langchain_community.vectorstores.jaguar import Jaguar vectorstore = Jaguar( pod = 'vdb', store = 'mystore', vector_index = 'v', vector_type = 'cosine_fraction_float', vector_dimension = 1536, url='http://192.168.8.88:8080/fwww/', embedding=openai_model ) podstrstore vector_index vector_typevector_dimensioninturl embeddingr c||_||_||_||_||_||_ ddlm}n#t$rtdwxYw|||_ d|_ dS)Nr)JaguarHttpClientzrCould not import jaguardb-http-client python package. Please install it with `pip install -U jaguardb-http-client`) _pod_store _vector_index _vector_type_vector_dimension _embedding%jaguardb_http_client.JaguarHttpClientr ImportError_jag_token) selfr rrrrrrrs c/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/vectorstores/jaguar.py__init__zJaguar.__init__$s  )'!1#  N N N N N N N   O   %$S))  s 3A rjaguar_api_key Optional[str]returnboolc|dkr|j}||_|j||_|jdkrt ddSdS)aX login to jaguardb server with a jaguar_api_key or let self._jag find a key Args: pod (str): name of a Pod store (str): name of a vector store optional jaguar_api_key (str): API key of user to jaguardb server Returns: True if successful; False if not successful rz*E0001 error init(): invalid jaguar_api_keyFT)r! getApiKey_jaguar_api_keyloginr"loggererror)r#r&s r$r-z Jaguar.login@si R  !Y0022N-ioon55 ;"   LLE F F F5t metadata_str text_sizeNonec|jdz|jz} d}||z }|d|jd|jdz }|d|jdz }|d|d z }||d zz }||d S) z create the vector store on the backend database Args: metadata_str (str): columns and their types Returns: True if successful; False if not successful .z create store  (z vector(,z 'z'),z source char(256), v:text char(z),)N)rrrrrrun)r#r1r2podstoreqs r$createz Jaguar.createWs9s?T[0   X  G$$ G Gd.D G G GG ($# ( ( (( resptxtjss r$r9z Jaguar.runqs ;"   LL4E444 5 5 5Iy~~eT[(;;i CBI   III sA++ A:9A:Optional[Embeddings]c|jSN)rr#s r$ embeddingszJaguar.embeddingss r0Ntexts List[str] metadatasOptional[List[dict]]kwargsrc |j}|dd}|dd}|jdz|jzdz|z}d|z}||} | dkrgS| d} |dkr$g} |D]} | |dz| z| }|jt|} g}|d }| D]}d |D}d |}|jdz|jz}d |zd z}||d z| zdz|zz }|| dd}|d|zdzz }||d} || d|dz }n]d }| D]W}d|D}| |||\}}}|dkr'|j |j|d}|sgcSd |}|d |zz }dd |zdz}|dd |zdzz }|jdz|jz}d |zd z}||d z| zdz|zz }|| dd}|d|zdzz }|dkr||d} n||d} || d|dz }Y|S)a Add texts through the embeddings and add to the vectorstore. Args: texts: list of text strings to add to the jaguar vector store. metadatas: Optional list of metadatas associated with the texts. [{"m1": "v11", "m2": "v12", "m3": "v13", "filecol": "path_file1.jpg" }, {"m1": "v21", "m2": "v22", "m3": "v23", "filecol": "path_file2.jpg" }, {"m1": "v31", "m2": "v32", "m3": "v33", "filecol": "path_file3.jpg" }, {"m1": "v41", "m2": "v42", "m3": "v43", "filecol": "path_file4.jpg" }] kwargs: vector_index=name_of_vector_index file_column=name_of_file_column Returns: List of ids from adding the texts into the vectorstore file_columnrtext_tagr5ztextcol data Nrc,g|]}t|Sr.0xs r$ z$Jaguar.add_texts..///a3q66///r0r7z insert into r6z ) values (''z\'z','')Fzidc,g|]}t|SrYrZr[s r$r^z$Jaguar.add_texts..r_r0,'z ) values (T)rgetrrr9appendrembed_documentslistjoinreplace _parseMetar!postFiler")r#rNrPrRvcolfilecolrU podstorevcolr;rHtextcol tag_textstrMidsivecstr_vec values_commar:rGnvecvvecfilepathrc names_commas r$ add_textszJaguar.add_textssW*!**]B//::j"--y34s:TA  % XXa[[ 88IV* r>>I 5 5  C!!34444E_44T%[[AA   A!  //3///"xx00 9s?T[8"X-4TCZ')M9LHHAh&&sE22US[4''XXa'' 2e9%%%Q A!  //3///'+y|W'M'M$dHb==++DK1EEB"! !hhtnn sTz) "UZZ%5%55; sxx'8'8 83 >> 9s?T[8"X-4[3&0<?,NNAh&&sE22TCZ$&&b==!T**BB!U++B 2e9%%%Q r0kfetch_kwhereargsOptional[List[str]]List[Tuple[Document, float]]c |j}|j} |j|} d| D} d| } |jdz|jz} d|zdz| zdzt|zdzt|zdz| z}|d z }||d|zz }|d |}|d |zz }|d | zz }||d|zz }||}|gSg}|D]_}|d}|d}|d}i}||d<||D]}||}|||<t||}||f}| |`|S)a Return Jaguar documents most similar to query, along with scores. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 3. lambda_val: lexical match parameter for hybrid search. where: the where clause in select similarity. For example a where can be "rating > 3.0 and (state = 'NV' or state = 'CA')" args: extra options passed to select similarity kwargs: vector_index=vcol, vector_type=cosine_fraction_float Returns: List of Documents most similar to the query and score for each. List of Tuples of (doc, similarity_score): [ (doc, score), (doc, score), ...] c,g|]}t|SrYrZr\fs r$r^z7Jaguar.similarity_search_with_score..555Q#a&&555r0r7r5zselect similarity(rez','topk=z ,fetch_k=z,type=z,with_score=yes,with_text=yesN&z ,metadata=z') from z where scorerBrb) page_contentmetadata) rrr embed_queryrjrrrr9rrg)r#r=rrrrrPrRrnvtyperMstr_embeddingsqv_commar:r;metajarrdocs_with_scorerHrrBrbmdmmvdoctups r$similarity_search_with_scorez#Jaguar.similarity_search_with_scores2!!_0077 55*55588N++9s?T[0       !ff     'll     ,,   tOA  88I&&D $ $A Z( ""   U" "Axx{{ <I ( (BwKEf:DU)CBBuI$"AABBqEEr:::C,C  " "3 ' ' ' 'r0List[Document]c >|j|f|||d|}d|DS)a Return Jaguar documents most similar to query, along with scores. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 5. where: the where clause in select similarity. For example a where can be "rating > 3.0 and (state = 'NV' or state = 'CA')" Returns: List of Documents most similar to the query )rrrPcg|]\}}|SrYrY)r\r_s r$r^z,Jaguar.similarity_search..Bs222Q222r0)r)r#r=rrrPrRdocs_and_scoress r$similarity_searchzJaguar.similarity_search-sJ$<$;  ey  .Srr0r7r5zselect anomalous(z, 'z ', 'type=raz from rF anomalousYEST) rrrrrjrrr9 isinstancerilenrCrD) r#r=rRrnrrMrrr:r;rHjds r$ is_anomalouszJaguar.is_anomalousDs!!_0077 55*55588N++9s?T[0 $ & . 9K G% ORV V X   XXa[[ b$   CGGqLL5 Z1   k?e # #4ur0c ||||||||} | | | | j|| fi| | SrK)r-clearr~) clsrNrrr rrrrrPr&rRjagstores r$ from_textszJaguar.from_textsask3  k3CS)   ~&&&5)66v666r0c^|jdz|jz}d|z}||dS)z\ Delete all records in jaguardb Args: No args Returns: None r5ztruncate store Nrrr9r#r:r;s r$rz Jaguar.clearxs3 9s?T[0  (  r0zidsc z|jdz|jz}|D]%}d|zdz|zdz}||&dS)z Delete records in jaguardb by a list of zero-ids Args: pod (str): name of a Pod ids (List[str]): a list of zid as string Returns: Do not return anything r5z delete from z where zid='r`Nr)r#rrRr:rbr;s r$deletez Jaguar.deletesY9s?T[0  C)N:S@3FA HHQKKKK  r0c |jdz|jz}d|z}||}t|trt |dkrdSt j|d}t|dS)z Count records of a store in jaguardb Args: no args Returns: (int) number of records in pod store r5zselect count() from rrV) rrr9rrirrCrDr)r#r:r;rHrs r$countz Jaguar.countsw 9s?T[0 "X - XXa[[ b$   CGGqLL1 Z1  2f:r0c^|jdz|jz}d|z}||dS)z` Drop or remove a store in jaguardb Args: no args Returns: None r5z drop store Nrrs r$dropz Jaguar.drops3 9s?T[0 H $  r0cD|j|jdS)zY Logout to cleanup resources Args: no args Returns: None N)r!logoutr"rLs r$rz Jaguar.logouts" %%%%%r0msgctdd5}td||dddddS#1swxYwYdS)Nz/tmp/debugjaguar.logazmsg=T)fileflush)openprint)r#rrs r$prtz Jaguar.prts (# . . 7$ ,,,T 6 6 6 6 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 7s 488nvmapro Tuple[List[str], List[str], str]cd}|dkrCt|}t|}ng}g}||vr8|||||||}|D]5\}}||kr*||||6d|D}|||fS)Nrc,g|]}t|SrYrZ)r\es r$r^z%Jaguar._parseMeta..s'''Q#a&&'''r0)rikeysvaluesrgitems) r#rror{ryrzrvvvec_ss r$rlzJaguar._parseMetas b== %%D ''DDDD% G$$$ E'N+++ >  # #1<<KKNNNKKNNN''$'''VX%%r0)r rrrrrrrrrrrrr )r)r&r'r(r))r1rr2rr(r3)F)r=rr>r)r(r?)r(rIrK)rNrOrPrQrRrr(rO)rrNNN)r=rrrrrrr'rr'rPrrRrr(r)rNN) r=rrrrr'rPrrRrr(r)r=rrRrr(r))Nr)rNrOrr rrr rrrrrrrrrrPrQr&r'rRrr(r )r(r3)rrOrRrr(r3)r(r)rrr(r3)rr?rorr(r)__name__ __module__ __qualname____doc__r%r-r<r9propertyrMr~rrr classmethodrrrrrrrrlrYr0r$r r s*<)+.4*X +/QQQQQl#")-NNNNNf#)- 33333.:+/(*[,        &&&&7777&&&&&&r0r ) __future__rrCloggingtypingrrrrlangchain_core.documentsrlangchain_core.embeddingsr langchain_core.vectorstoresr getLoggerrr.r rYr0r$rs"""""" ------------------000000333333  8 $ $y&y&y&y&y&[y&y&y&y&y&r0