NgqddlZddlZddlmZmZmZmZddlmZddl m Z ej e Z Gdde ZdS)N)DictListOptionalSequence)Document) BaseLoaderceZdZdZddddddedededeed eeed eeed ed dfd Z d e e fdZ d e e fdZ d eefdZ ddedeeded efdZdS) MongodbLoaderzLoad MongoDB documents.NT)filter_criteria field_namesmetadata_names!include_db_collection_in_metadataconnection_stringdb_namecollection_namer r r rreturnc ddlm}n"#t$r} td| d} ~ wwxYw|std|std|std|||_||_||_|pg|_|pi|_|pg|_ ||_ |j ||_ |j ||_dS)a Initializes the MongoDB loader with necessary database connection details and configurations. Args: connection_string (str): MongoDB connection URI. db_name (str):Name of the database to connect to. collection_name (str): Name of the collection to fetch documents from. filter_criteria (Optional[Dict]): MongoDB filter criteria for querying documents. field_names (Optional[Sequence[str]]): List of field names to retrieve from documents. metadata_names (Optional[Sequence[str]]): Additional metadata fields to extract from documents. include_db_collection_in_metadata (bool): Flag to include database and collection names in metadata. Raises: ImportError: If the motor library is not installed. ValueError: If any necessary argument is missing. r)AsyncIOMotorClientzBCannot import from motor, please install with `pip install motor`.Nz#connection_string must be provided.zdb_name must be provided.z!collection_name must be provided.)motor.motor_asyncior ImportError ValueErrorclientrrr r r r get_databasedbget_collection collection) selfrrrr r r rres h/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/document_loaders/mongodb.py__init__zMongodbLoader.__init__s @  > > > > > > >   T   ! DBCC C :899 9 B@AA A(():;;  .&,".4",21R.+**733'00AAs (#(cNtj|S)aLoad data into Document objects. Attention: This implementation starts an asyncio event loop which will only work if running in a sync env. In an async env, it should fail since there is already an event loop running. This code should be updated to kick off the event loop from a separate thread if running within an async context. )asynciorunaload)rs rloadzMongodbLoader.loadJs{4::<<(((cKg}|j|jd{V}|}|j|j|23d{V}|||jd}|jr"||j |j d|j Q|||j d}d| D}d |}nt|}|t!||6t#||kr.t$dt#|d |d |S) z0Asynchronously loads data into Document objects.N)default)databaserc,g|]}t|S)str).0values r z'MongodbLoader.aload..ksAAAUAAAr& ) page_contentmetadataz6Only partial collection of documents returned. Loaded z docs, expected .)rcount_documentsr _construct_projectionfind_extract_fieldsr rupdaterrr valuesjoinr-appendrlenloggerwarning) rresult total_docs projectiondocr3fieldstextstexts rr$zMongodbLoader.aloadXs?::4;OPPPPPPPP //11 --d.BJOO J J J J J J J#++C1Db+QQH5 !%T=QRR +--c43CR-PPAAAAAxx3xx MM(xHHH I I I I#P& v;;* $ $ NNEf++EE7AEEE     sD7ct|jpg}t|jpg}||z}|r d|DndS)zuConstructs the projection dictionary for MongoDB query based on the specified field names and metadata names.ci|]}|dS)r,)r.fields r z7MongodbLoader._construct_projection..s111Uq111r&N)listr r )rr r all_fieldss rr6z#MongodbLoader._construct_projectionzsW4+,,2 d1228b >1 5?I11j1111TIr&r(documentrDr)ci}|pgD]U}|}|dD] }|||}||krn!|dd}|||<V|S)zAExtracts and returns values for specified fields from a document.r4_)splitgetreplace) rrNrDr) extractedrJr/keynew_field_names rr8zMongodbLoader._extract_fieldss \r . .EE{{3''   #w//G##E$"]]344N(-In % %r&)r()__name__ __module__ __qualname____doc__r-rrrboolr rrr%r$r6r8r,r&rr r sd!!+//326269B9B9B9B9B 9B "$ 9Bhsm,9B!#/9B,09B 9B9B9B9Bv )d8n ) ) ) ) T(^    DJx~JJJJ     r&r )r"loggingtypingrrrrlangchain_core.documentsr)langchain_community.document_loaders.baser getLoggerrWr>r r,r&rras111111111111------@@@@@@  8 $ $FFFFFJFFFFFr&