NgzdZddlZddlmZmZmZmZddlZddlZddl m Z ddl m Z m Z mZdZGdde ZdS) zWUtil that calls Metaphor Search API. In order to set this up, follow instructions at: N)AnyDictListOptionalget_from_dict_or_env) BaseModel ConfigDictmodel_validatorzhttps://api.metaphor.systemsceZdZUdZeed<dZeed<edZ dded ed e e ed e e ed e ed e ede ede ede e de e fdZedededefdZ dded ed e e ed e e ed e ed e ede ede ede e de efdZ dded ed e e ed e e ed e ed e ede ede ede e de efdZde ede efdZdS)MetaphorSearchAPIWrapperz Wrapper for Metaphor Search API.metaphor_api_key kforbid)extraNquery num_resultsinclude_domainsexclude_domainsstart_crawl_dateend_crawl_datestart_published_dateend_published_dateuse_autopromptreturnc d|ji} ||||||||| d } tjtd| | } | | } | dS)N X-Api-Key numResultsrincludeDomainsexcludeDomainsstartCrawlDate endCrawlDatestartPublishedDateendPublishedDate useAutoprompt/search)headersjsonresults)rrequestspostMETAPHOR_API_URLraise_for_statusr*)selfrrrrrrrrrr)paramsresponsesearch_resultss i/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/utilities/metaphor_search.py_metaphor_search_resultsz1MetaphorSearchAPIWrapper._metaphor_search_resultss 56%--.*"6 2+   = ( ( (     !!###!i((before)modevaluesc2t|dd}||d<|S)z9Validate that api key and endpoint exists in environment.rMETAPHOR_API_KEYr)clsr9rs r4validate_environmentz-MetaphorSearchAPIWrapper.validate_environment>s/0 &(:  &6!" r6c h||||||||||  } || S)aLRun query through Metaphor Search and return metadata. Args: query: The query to search for. num_results: The number of results to return. include_domains: A list of domains to include in the search. Only one of include_domains and exclude_domains should be defined. exclude_domains: A list of domains to exclude from the search. Only one of include_domains and exclude_domains should be defined. start_crawl_date: If specified, only pages we crawled after start_crawl_date will be returned. end_crawl_date: If specified, only pages we crawled before end_crawl_date will be returned. start_published_date: If specified, only pages published after start_published_date will be returned. end_published_date: If specified, only pages published before end_published_date will be returned. use_autoprompt: If true, we turn your query into a more Metaphor-friendly query. Adds latency. Returns: A list of dictionaries with the following keys: title - The title of the page url - The url author - Author of the content, if applicable. Otherwise, None. published_date - Estimated date published in YYYY-MM-DD format. Otherwise, None. )rrrrrrrr)r5_clean_results) r0rrrrrrrrrraw_search_resultss r4r+z MetaphorSearchAPIWrapper.resultsIsRB":: #++-)!51);   ""#5666r6c  Kdtf f d } | d{V} tj| } | dS)z8Get results from the Metaphor Search API asynchronously.rc  Kd ji}   d }tj4d{V}|td||4d{V }|jdkr@|d{V}|cdddd{Vcdddd{VStd|jd|j#1d{VswxYwY dddd{VdS#1d{VswxYwYdS)Nrrr()r*r)zError z: ) raiohttp ClientSessionr-r.statustext Exceptionreason)r)r1sessionresdatarrrrrrr0rrrs r4fetchz5MetaphorSearchAPIWrapper.results_async..fetchs"D$9:G)"1"1"2 .&:$6!/  F,.. M M M M M M M'"<<'000vw(MMMMMMMMzS((%(XXZZ//////# MMMMMMMMMMMMM M M M M M M M M M M M M M M((K(K(Ksz(K(KLLLMMMMMMMMMMMMMMM M M M M M M M M M M M M M M M M M M M M M M M M M M M M M Ms;'C*'CC*&C C C*C C** C47C4Nr+)strr*loadsr?) r0rrrrrrrrrrMresults_json_str results_jsons `````````` r4 results_asyncz&MetaphorSearchAPIWrapper.results_asyncws MS M M M M M M M M M M M M M M M."'======z"233 ""< #:;;;r6r@c g}|D]l}||dd|dd|dd|ddd m|S) Ntitlez Unknown Titleurlz Unknown URLauthorzUnknown Author publishedDatez Unknown Date)rTrUrVpublished_date)appendget)r0r@cleaned_resultsresults r4r?z'MetaphorSearchAPIWrapper._clean_resultss(  F  " "#ZZAA!::e];;$jj3CDD&,jj.&Q&Q     r6)NNNNNNN)__name__ __module__ __qualname____doc__rN__annotations__rintr model_configrrbooldictr5r classmethodrrr=r+rRr?r6r4r r s** AsKKK:L04/3*.(,.2,0)-!)!)!)!)"$s), !) "$s), !) #3- !)! !)'sm!)%SM!)!!) d!)!)!)!)F_(###$3[$#04/3*.(,.2,0)-,7,7,7,7"$s), ,7 "$s), ,7 #3- ,7! ,7'sm,7%SM,7!,7 d,7,7,7,7d04/3*.(,.2,0)-(<(<(<(<"$s), (< "$s), (< #3- (<! (<'sm(<%SM(<!(< d(<(<(<(rks  ,,,,,,,,,,,,555555;;;;;;;;;;1[[[[[y[[[[[r6