Ng tddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z dde de dedejfdZdde de ded ede f d Zdde de ded ede f d Zde dee fd Zde dee fdZde dee fdZde dee fdZde deejfdZde fdZdefdZde dee fdZdS)N)ListOptional)EMAIL_ADDRESS_PATTERNEMAIL_DATETIMETZ_PATTERNIMAGE_URL_PATTERNIP_ADDRESS_NAME_PATTERNIP_ADDRESS_PATTERN_REMAPI_ID_PATTERNUS_PHONE_NUMBERS_REtextpatternindexreturnct|tr|dkrtd|dd}tt j||D] \}}||kr|}|td|d|d|S)Nrz The index is z'. Index must be a non-negative integer.zResult with index z& was not found. The largest index was .) isinstanceint ValueError enumeraterefinditer)r r r regex_matchiresults Y/var/www/html/ai-engine/env/lib/python3.11/site-packages/unstructured/cleaners/extract.py_get_indexed_matchrs eS ! !YUQYYWWWWXXXKr{7D99::!! 6 :: K_e__[\___``` Tstripct|||}|\}}|d|}|r|n|S)aExtracts texts that occurs before the specified pattern. By default, it will use the first occurrence of the pattern (index 0). Use the index kwarg to choose a different index. Input ----- strip: If True, removes trailing whitespace from the extracted string N)rspanrstrip)r r rrrstart_ before_texts rextract_text_beforer%sS%T7E::K!!HE1vv,K#( 9;     k9rct|||}|\}}||d}|r|n|S)aExtracts texts that occurs before the specified pattern. By default, it will use the first occurrence of the pattern (index 0). Use the index kwarg to choose a different index. Input ----- strip: If True, removes leading whitespace from the extracted string N)rr lstrip)r r rrrr#endr$s rextract_text_afterr).sS%T7E::K     FAsstt*K#( 9;     k9rcZtjt|SN)rfindallrlowerr s rextract_email_addressr/=s :+TZZ\\ : ::rc6tjt|Sr+)rr,r r.s rextract_ip_addressr1As :+T 2 22rc6tjt|Sr+)rr,rr.s rextract_ip_address_namer3Es :-t 4 44rcRtjt|}d|D}|S)Nc:g|]}|ddS);)replace).0mids r z#extract_mapi_id..Ks&999 C$$999r)rr,r )r mapi_idss rextract_mapi_idr=Is+z/400H99999H Orctjt|}t|dkr&tj|ddSdS)Nrz%a, %d %b %Y %H:%M:%S %z)rr,rlendatetimestrptime)r date_extractionss rextract_datetimetzrCOsNz":DAA q   ))*:1*=?YZZZtrctj|}|dS|\}}|||}|S)aExtracts a US phone number from a section of text that includes a phone number. If there is no phone number present, the result will be an empty string. Example ------- extract_phone_number("Phone Number: 215-867-5309") -> "215-867-5309" Nr7)r searchr r)r rr"r( phone_numbers rextract_us_phone_numberrGWsS&,T22Kr!!##JE3c ?L     rcd\}}}}|}td|dvd|dvgr|||fStjd|d}|ds|d=t|ddkr|||fS|^}}|rG |^}}}n#t$r|}YnwxYwd |}|rd |nd }|||fS) aExtracts the start of bulleted text sections bullets accounting numeric and alphanumeric types. Output ----- tuple(section, sub_section, sub_sub_section): Each bullet partition is a string or None if not present. Example ------- This is a very important point -> (None, None, None) 1.1 This is a very important point -> ("1", "1", None) a.1 This is a very important point -> ("a", "1", None) )NNNNrrz..z[\.])r stringr7N)splitanyrr?rjoin)r abctemptext_spbulletr#s rextract_ordered_bulletsrUhs+MAq!TjjllG Cwqz !471:#5 677!Qw Xggaj 9 9 9F ": 2J 6!9~~!QwHA & HAq11   AAA  GGAJJ %BGGAJJJ a7NsB B#"B#c6tjt|Sr+)rr,rr.s rextract_image_urls_from_htmlrWs :' . ..r)r)rT)r@rtypingrrunstructured.nlp.patternsrrrrr r r strrMatchrboolr%r)r/r1r3r=rCrGtuplerUrWrrr_sc !!!!!!!!  S 3 s 28     : :c :C : : :X[ : : : : : :S :3 :s :t :WZ : : : :;;S ;;;;3S3T#Y33335#5$s)5555#$s) SXh.?%@ #    "#U####L/s/tCy//////r