Ng v d dl Z d dlZd dlmZmZmZmZmZ d dlm Z m
Z
d dl m Z d dl
mZ G d de ZdS ) N)AnyDictListLiteralOptional)#AsyncCallbackManagerForRetrieverRun CallbackManagerForRetrieverRun)Document)
BaseRetrieverc | e Zd ZU dZdZeed< dZeed< dZe e ed< dZ
e e ed< d Z e d
ed < d gZ
ee d
ed< dZeed< dZeed< i Ze eeef ed< dZe e ed< dZe e ed< dededee fdZdede dee fdZ dedee fd Z dS ) AskNewsRetrieverzAskNews retriever.
kr offsetNstart_timestamp
end_timestampnl)r kwmethodAll)r BusinessCrimePoliticsScienceSports
TechnologyMilitaryHealth
EntertainmentFinanceCultureClimate EnvironmentWorld
categoriesF
historicalg ?similarity_score_thresholdkwargs client_id
client_secretquery run_managerreturnc ddl m} n # t $ r t d w xY w || j pt j d | j pt j d dg } |j j d || j | j
| j | j | j
| j | j | j dd d
d | j }| | S )
zGet documents relevant to a query.
Args:
query: String to find relevant documents for
run_manager: The callbacks handler to use
Returns:
List of relevant documents
r )
AskNewsSDKOAskNews python package not found. Please install it with `pip install asknews`.ASKNEWS_CLIENT_IDASKNEWS_CLIENT_SECRETnewsr) r* scopesboth) r+
n_articlesr r r r% r& r' r doc_start_delimiterdoc_end_delimiter return_type ) asknews_sdkr/ ImportErrorr) osenvironr* r3 search_newsr r r r r% r& r' r r( _extract_documents)selfr+ r, r/ an_clientresponses b/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/retrievers/asknews.py_get_relevant_documentsz(AskNewsRetriever._get_relevant_documents. s . . . . . . . @
JnG
3F(G ,S
;R0S8
.9>-
v 0 ,;'+'F; ' &
k
&&x000s #c K ddl m} n # t $ r t d w xY w || j pt j d | j pt j d dg } |j j d
|| j | j
| j | j | j
| j | j | j dd d
d | j d {V }| | S )zAsynchronously get documents relevant to a query.
Args:
query: String to find relevant documents for
run_manager: The callbacks handler to use
Returns:
List of relevant documents
r )AsyncAskNewsSDKr0 r1 r2 r3 r4 r8 r6 r7 ) r+ r9 r r r r% r& r' r r< r: r; Nr= )r> rJ r? r) r@ rA r* r3 rB r r r r r% r& r' r r( rC )rD r+ r, rJ rE rF s rG _aget_relevant_documentsz)AskNewsRetriever._aget_relevant_documentsV s. 3 3 3 3 3 3 3 @
$OnG
3F(G ,S
;R0S8
4 3
v 0 ,;'+'F; ' &
k
&&x000s %rF c ddl m} |t j dj t j fdt
t D }|S )z'Extract documents from an api response.r )SearchResponsez(.*?)c
g | ]}t | j | j j | j r t j | j nd j | j d S )N)titlesourceimages) page_contentmetadata)r
stripas_dictsrO article_urlstr image_url).0imatchessrs rG
z7AskNewsRetriever._extract_documents.. s
$QZ - - / / [^ 1{1~1 c"+a."< = = = k!n 6
)asknews_sdk.dto.newsrM refindall as_stringDOTALLrangelen)rD rF rM docsr[ r\ s @@rG rC z#AskNewsRetriever._extract_documents~ sy 877777 %* 0", JJ
3w<<((
r^ ) __name__
__module__ __qualname____doc__r int__annotations__r r r r r r r% r r& boolr' floatr( r rW r r) r* r r
rH r rK rC r= r^ rG r
r
s
AsKKKFCOOO%)OXc])))#'M8C='''"&FGJ &&&&
%
& J (+ +++')FHT#s(^ $))) #Ix}####'M8C='''&1&1*H&1
h &1 &1 &1 &1P&1&1*M&1
h &1 &1 &1 &1P3 4> r^ r
)r@ r` typingr r r r r langchain_core.callbacksr r langchain_core.documentsr
langchain_core.retrieversr r
r= r^ rG rs s 5 5 5 5 5 5 5 5 5 5 5 5 5 5 . - - - - - 3 3 3 3 3 3E E E E E} E E E E Er^