Ng!dZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ed d e d e fd ZeGd dZeZdS)a This module contains variables that can permitted to be tweaked by the system environment. For example, model parameters that changes the output of an inference call. Constants do NOT belong in this module. Constants are values that are usually names for common options (e.g., color names) or settings that should not be altered without making a code change (e.g., definition of 1Gb of memory in bytes). Constants should go into `./constants.py` N) dataclass) lru_cache)Path)Optional)OCR_AGENT_TESSERACT)maxsizedirreturncnt|dtjdz }t|S)Nztmp/r)rosgetpgidstr)r tempdirs _/var/www/html/ai-engine/env/lib/python3.11/site-packages/unstructured/partition/utils/config.py get_tempdirrs/3ii0A000G w<<cBeZdZdZdZd'dededefdZdededefdZdede de fd Z dede de fd Z d edd fd Z edefdZedefdZede fdZedefdZedefdZedefdZedefdZedefdZedefdZedefdZede fdZede fdZede fdZede fdZede fdZede fdZede fdZedefdZ edefd Z!ede fd!Z"ede fd"Z#ede fd#Z$ede fd$Z%ede&e fd%Z'edefd&Z(d S)( ENVConfigz+class for configuring enviorment parameterscL|jr||jdSdSN)GLOBAL_WORKING_DIR_ENABLED _setup_tmpdirGLOBAL_WORKING_PROCESS_DIRselfs r __post_init__zENVConfig.__post_init__s7  * @   t> ? ? ? ? ? @ @rvar default_valuer cBtj||S)zhattempt to get the value of var from the os environment; if not present return the default_value)r environget)rrr s r _get_stringzENVConfig._get_string!sz~~c=111rcR||x}rt|S|Sr)r$intrrr values r_get_intzENVConfig._get_int&s/$$S)) )5 u:: rcR||x}rt|S|Sr)r$floatr's r _get_floatzENVConfig._get_float+s/$$S)) )5 << rc`||x}r|dvS|S)N)true1t)r$lowerr's r _get_boolzENVConfig._get_bool0s7$$S)) )5 7;;==$66 6rtmpdirNcft|dd|t_dS)NT)parentsexist_ok)rmkdirtempfiler)rr3s rrzENVConfig._setup_tmpdir5s/ V 4$777!rc.|ddS)zRextra image content to add around an identified element region; measured in pixelsIMAGE_CROP_PADrr)rs rr:zENVConfig.IMAGE_CROP_PAD9s}}-q111rc.|ddS)zextra image content to add around an identified table region; measured in pixels The padding adds image data around an identified table bounding box for downstream table structure detection model use as input TABLE_IMAGE_CROP_PADrr;rs rr=zENVConfig.TABLE_IMAGE_CROP_PAD>s}}3Q777rc.|ddS)z%the quantile to check for text heightTESSERACT_TEXT_HEIGHT_QUANTILE?r,rs rr?z(ENVConfig.TESSERACT_TEXT_HEIGHT_QUANTILEGs?EEErc.|ddS)zminimum text height acceptable from tesseract OCR results if estimated text height from tesseract OCR results is lower than this value the image is scaled up to be processed again TESSERACT_MIN_TEXT_HEIGHT r;rs rrCz#ENVConfig.TESSERACT_MIN_TEXT_HEIGHTLs}}8"===rc.|ddS)zmaximum text height acceptable from tesseract OCR results if estimated text height from tesseract OCR results is higher than this value the image is scaled down to be processed again TESSERACT_MAX_TEXT_HEIGHTdr;rs rrFz#ENVConfig.TESSERACT_MAX_TEXT_HEIGHTUs}}8#>>>rc.|ddS)z%optimum text height for tesseract OCRTESSERACT_OPTIMUM_TEXT_HEIGHTr;rs rrIz'ENVConfig.TESSERACT_OPTIMUM_TEXT_HEIGHT^s}}>>rc.|ddS)a9threshold to determine if an OCR region is a sub-region of a given block when aggregating the text from OCR'd elements that lie within the given block When the intersection region area divided by self area is larger than this threshold self is considered a subregion of the other OCR_LAYOUT_SUBREGION_THRESHOLDr@rArs rrXz(ENVConfig.OCR_LAYOUT_SUBREGION_THRESHOLDs?EEErc.|ddS)Rthreshold to consider the bounding boxes of two embedded images as the same region$EMBEDDED_IMAGE_SAME_REGION_THRESHOLDg333333?rArs rr[z.ENVConfig.EMBEDDED_IMAGE_SAME_REGION_THRESHOLDsEsKKKrc.|ddS)aAthreshold to determine if an embedded region is a sub-region of a given block when aggregating the text from embedded elements that lie within the given block When the intersection region area divided by self area is larger than this threshold self is considered a subregion of the other -EMBEDDED_TEXT_AGGREGATION_SUBREGION_THRESHOLDgGz?rArs rr]z7ENVConfig.EMBEDDED_TEXT_AGGREGATION_SUBREGION_THRESHOLDsNPTUUUrc.|ddS)rZ#EMBEDDED_TEXT_SAME_REGION_THRESHOLD?rArs rr_z-ENVConfig.EMBEDDED_TEXT_SAME_REGION_THRESHOLDsDcJJJrc.|ddS)zThe threshold value (between 0.0 and 1.0) that determines the minimum overlap required for an annotation to be considered within the element. PDF_ANNOTATION_THRESHOLDr`rArs rrbz"ENVConfig.PDF_ANNOTATION_THRESHOLDs 93???rc.|ddS)zBEnable usage of GLOBAL_WORKING_DIR and GLOBAL_WORKING_PROCESS_DIR.rFrVrs rrz$ENVConfig.GLOBAL_WORKING_DIR_ENABLEDs~~:EBBBrcp|dttjdz S)z%Path to Unstructured cache directory.GLOBAL_WORKING_DIRz.cache/unstructured)r$rrhomers rrezENVConfig.GLOBAL_WORKING_DIRs/ 4c$)++H]:]6^6^___rct|j}|d|}|dkr|}|jr|||S)zPath to Unstructured cache tempdir. Overrides TMPDIR, TEMP and TMP. Defaults to '{GLOBAL_WORKING_DIR}/tmp/{os.getpgid(0)}'. )r rr)rrer$rr)rdefault_tmpdirr3s rrz$ENVConfig.GLOBAL_WORKING_PROCESS_DIRs_ %)@AAA!!">OO R<<#F  * '   v & & & rc.|ddS)z)Analysis dump object detection skip flag.ANALYSIS_DUMP_OD_SKIPFrVrs rrjzENVConfig.ANALYSIS_DUMP_OD_SKIPs~~5u===rc.|ddS)z(Analysis draw bboxes on pages skip flag.ANALYSIS_BBOX_SKIPFrVrs rrlzENVConfig.ANALYSIS_BBOX_SKIPs~~2E:::rc.|ddS)z@Flag for drawing the analysis bboxes on a single image (as grid)ANALYSIS_BBOX_DRAW_GRIDFrVrs rrnz!ENVConfig.ANALYSIS_BBOX_DRAW_GRIDs~~7???rc.|ddS)zMFlag for drawing the caption above the analysed page (for e.g. layout source)ANALYSIS_BBOX_DRAW_CAPTIONTrVrs rrpz$ENVConfig.ANALYSIS_BBOX_DRAW_CAPTIONs~~:DAAArcB|dd}|dkrdS|S)zAnalaysis bbox resize valueANALYSIS_BBOX_RESIZEgNrA)rresizes rrrzENVConfig.ANALYSIS_BBOX_RESIZEs+!7>> T>>4 rc.|ddS)zJThe format for analysed pages with bboxes drawn on them. Default is 'png'.ANALYSIS_BBOX_FORMATpngrMrs rruzENVConfig.ANALYSIS_BBOX_FORMATs 6>>>r)r))__name__ __module__ __qualname____doc__rrr$r&r)r+r,boolr2rpropertyr:r=r?rCrFrIrLrOrQrSrUrXr[r]r_rbrrerrjrlrnrprrrrurrrrs55@@@22s2322222 C c%E S$ "C"D""""2222X28c888X8FFFFXF>3>>>X>?3???X?BsBBBXBA3AAAXAB3BBBXBKKKKXK IsIIIXI ????X?FFFFXFLeLLLXLVuVVVXVKUKKKXK@%@@@X@CDCCCXC`C```X` C   X >t>>>X>;D;;;X;@@@@X@BDBBBXBhuoX?c???X???rr)rzr r8 dataclassesr functoolsrpathlibrtypingr&unstructured.partition.utils.constantsrrrr env_configr}rrrs !!!!!!FFFFFF 1SS  B?B?B?B?B?B?B? B?JY[[ r