Ng rdZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z Gdd e ZdS) z-Wrapper around Elasticsearch vector database.) annotationsN)AnyIterableList)CallbackManagerForRetrieverRun)Document) BaseRetrieverc\eZdZUdZded< ded< e ddd Z dddZddZdS) ElasticSearchBM25Retrievera?`Elasticsearch` retriever that uses `BM25`. To connect to an Elasticsearch instance that requires login credentials, including Elastic Cloud, use the Elasticsearch URL format https://username:password@es_host:9243. For example, to connect to Elastic Cloud, create the Elasticsearch URL with the required authentication details and pass it to the ElasticVectorSearch constructor as the named parameter elasticsearch_url. You can obtain your Elastic Cloud URL and login credentials by logging in to the Elastic Cloud console at https://cloud.elastic.co, selecting your deployment, and navigating to the "Deployments" page. To obtain your Elastic Cloud password for the default "elastic" user: 1. Log in to the Elastic Cloud console at https://cloud.elastic.co 2. Go to "Security" > "Users" 3. Locate the "elastic" user and click "Edit" 4. Click "Reset password" 5. Follow the prompts to reset the password The format for Elastic Cloud URLs is https://username:password@cluster_id.region_id.gcp.cloud.es.io:9243. rclientstr index_name@?elasticsearch_urlk1floatbreturncddlm}||}ddddiiidd||d id }d d d ddii}|j||||||S)aD Create a ElasticSearchBM25Retriever from a list of texts. Args: elasticsearch_url: URL of the Elasticsearch instance to connect to. index_name: Name of the index to use in Elasticsearch. k1: BM25 parameter k1. b: BM25 parameter b. Returns: r) Elasticsearchanalyzerdefaulttypestandard custom_bm25BM25)rrr)analysis similarity propertiescontenttext)rr)indexmappingssettings)r r) elasticsearchrindicescreate) clsrrrrresr%r$s n/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/retrievers/elastic_search_bm25.pyr(z!ElasticSearchBM25Retriever.create,s 0/////], - -$i&*1E%FG"      ""/   XQQQs"4444Ttexts Iterable[str]refresh_indicesbool List[str]c ddlm}n#t$rtdwxYwg}g}t|D][\}}t t j}d|j||d} |||| \||j ||r%|j j |j|S)a.Run more texts through the embeddings and add to the retriever. Args: texts: Iterable of strings to add to the retriever. refresh_indices: bool to refresh ElasticSearch indices Returns: List of ids from adding the texts into the retriever. r)bulkzbCould not import elasticsearch python package. Please install it with `pip install elasticsearch`.r#)_op_type_indexr!_id)r#) elasticsearch.helpersr3 ImportError enumerater uuiduuid4rappendr r'refresh) selfr-r/r3requestsidsir"r6requests r+ add_textsz$ElasticSearchBM25Retriever.add_textsYs  2 2 2 2 2 2 2   F    '' % %GAtdjll##C#/ G JJsOOO OOG $ $ $ $ T[(###  ? K  ' 'do ' > > > s #query run_managerrList[Document]cddd|iii}|j|j|}g}|ddD]1}|t |dd2|S)NrDmatchr!)r#bodyhits_source) page_content)r searchrr<r)r>rDrE query_dictresdocsrs r+_get_relevant_documentsz2ElasticSearchBM25Retriever._get_relevant_documentss)U);<= k  tZ HHVV$ H HA KKa l9.EFFF G G G G r,N)rr) rr rr rrrrrr )T)r-r.r/r0rr1)rDr rErrrF) __name__ __module__ __qualname____doc____annotations__ classmethodr(rCrRr,r+r r s2KKKOOO4RV*5*5*5*5[*5^!%%%%%%N      r,r )rV __future__rr:typingrrrlangchain_core.callbacksrlangchain_core.documentsrlangchain_core.retrieversr r rYr,r+r_s33"""""" &&&&&&&&&&CCCCCC------333333||||||||||r,