NgdZddlmZddlZddlmZmZmZmZddl m Z ddl m Z ddl mZerddl mZdd ZGddZGddZGddZdS)zProvides operations related to the HTML table stored in `.metadata.text_as_html`. Used during partitioning as well as chunking. ) annotationsN) TYPE_CHECKINGIteratorSequencecast)etree)fragment_fromstring) lazyproperty) HtmlElementmatrixSequence[Sequence[str]]returnstrcdd fd }d d|r"d d ||d nd S)aForm an HTML table from "rows" and "columns" of `matrix`. Character overhead is minimized: - No whitespace padding is added for human readability - No newlines (" ") are added - No ``, ``, or `` elements are used; we can't tell where those might be semantically appropriate anyway so at best they would consume unnecessary space and at worst would be misleading. rows_of_cell_strsr r Iterator[str]c3dK|D])}|sdd|dV*dS)Nzzjoin)r row_cell_strsiter_tdss Z/var/www/html/ai-engine/env/lib/python3.11/site-packages/unstructured/common/html_table.pyiter_trsz.htmlify_matrix_of_cell_texts..iter_trss_. A AM  @-!8!899@@@ @ @ @ @  A Ar Sequence[str]c3K|D]q}tj|}d|d}d|}|rd|dndVrdS)Nz
  zz)htmlescapersplit)rs cell_texts rrz.htmlify_matrix_of_cell_texts..iter_tds&s D DA AA QWWT]]++A++I-6C)))))G C C C C D Drzrz
)rr rr)rrrrr)r rrs @rhtmlify_matrix_of_cell_textsr&stAAAAAA D D D D=C J 8RWWXXf--.. 8 8 8 8JrcjeZdZdZddZeddZedd Zdd Z edd Z d S) HtmlTablezA `` element.tabler c||_dSN)_table)selfr)s r__init__zHtmlTable.__init__7s  r html_textrrct|}|d}|std|d}|d}|D]}||D]s}|j|jdkrd|_|jr1d |j |_|j rd|_ t||S)Nz//tablez)`html_text` contains no `
` elementrz.//thead | .//tbody | .//tfootthtdr) r xpath ValueErrordrop_tagiterattribcleartagtextrr#tail)clsr/roottablesr)noise_elementses rfrom_html_textzHtmlTable.from_html_text:s#9--I&& JHII Iq %EFF  A JJLLLL  A HNN   u}}v 2!&,,..11v s5zzrcBtj|jtS)aThe HTML-fragment for this `
` element, all on one line. Like: `
foo
bar
` The HTML contains no human-readability whitespace, attributes, or ``, ``, or `` tags. It is made as compact as possible to maximize the semantic content in a given space. This is particularly important for chunking. encoding)rtostringr,rr-s rr!zHtmlTable.html]s~dkC8888rIterator[HtmlRow]c#zKdtd|jdDEd{VdS)Nc34K|]}t|VdSr+)HtmlRow).0trs r z&HtmlTable.iter_rows..js(__BGBKK______rzlist[HtmlElement]z./tr)rr,r3rFs r iter_rowszHtmlTable.iter_rowsisN__$/BDKDUDUV\D]D]*^*^____________rcd|j}d|S)z-The clean, concatenated, text for this table.r)rr,itertextr#)r- table_texts rr:zHtmlTable.textlsAXXdk224455 xx ((**+++rN)r)r )r/rrr(rr)rrG) __name__ __module__ __qualname____doc__r. classmethodrAr r!rNr:rrr(r(4s   [ D 9 9 9\ 9````,,,\,,,rr(cBeZdZdZd dZeddZdd Zdd Zd S)rJzA `` element.rLr c||_dSr+)_tr)r-rLs rr.zHtmlRow.__init__w rrrcBtj|jtS)z*Like "foobar".rC)rrEr[rrFs rr!z HtmlRow.htmlzs~dh5555rIterator[HtmlCell]c#@K|jD]}t|VdSr+)r[HtmlCellr-r2s r iter_cellszHtmlRow.iter_cellss6(  B2,,      rrc#hK|jD]'}|jx} |}|s#|V(dS)zGenerate contents of each cell of this row as a separate string. A cell that is empty or contains only whitespace does not generate a string. N)r[r:strip)r-r2r:s riter_cell_textszHtmlRow.iter_cell_textssU (  B(::<` element.r2r c||_dSr+)_tdras rr.zHtmlCell.__init__r\rrrcT|jr tj|jtndS)zLike "foo bar baz".rCr )r:rrErhrrFs rr!z HtmlCell.htmls':>Ou~dh5555OrcJ|jjx}dS|S)z6Text inside `` element, empty string when no text.Nr)rhr:rd)r-r:s rr:z HtmlCell.texts&HM !D *2zz||rN)r2r rR)rSrTrUrVr.r r!r:rXrrr`r`srPPP\P\rr`)r r rr)rV __future__rr!typingrrrrlxmlr lxml.htmlr unstructured.utilsr r r&r(rJr`rXrrrps< #""""" ::::::::::::))))))++++++&%%%%%%KKKK@=,=,=,=,=,=,=,=,@:r