Ng dZddlZddlmZddlmZmZmZddlm Z ddl m Z de de d ed e d ef d Zd ed efdZGdde ZdS)zLoads .ipynb notebook files.N)Path)AnyListUnion)Document) BaseLoadercellinclude_outputsmax_output_length tracebackreturnc |d}|d}|r |d}n#t$rYnwxYw|r|dkr|rd|dvrM|dd}|dd}|r |dd}d |d |d |d |d |d Sd |d |d |d|d S|dddkr?|dd}t|t|} d |d |d|d| dSn d |d |dSdS)asCombine cells information in a readable format ready to be used. Args: cell: A dictionary include_outputs: Whether to include the outputs of the cell. max_output_length: Maximum length of the output to be displayed. traceback: Whether to return a traceback of the error. Returns: A string with the cell information. cell_typesourceoutputscodeenamerevaluer 'z ' cell: 'z' , gives error 'z', with description 'z' and traceback 'z' z',with description ' output_typestreamtextz' with output: 'N)KeyErrorkeysminlen) r r r r rroutput error_name error_value min_outputs i/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/document_loaders/notebook.pyconcatenate_cellsr# s[!I (^F )_FF    D 59..6. fQinn&& & &7+J )H-K "1Ik2 7 77F77j77*577&/777< <z#remove_newlines..Fs 444$%%444c4i|]\}}|t|Sr(r)r+kvs r" z#remove_newlines..Hs&>>>&1a?1%%>>>r.) isinstancestrreplacelistdictitems)r$s r"r*r*@s!Syyr""" At  44!4444 At  >>AGGII>>>>r.c `eZdZdZ d deeefdedededef d Z d e e fd Z d S)NotebookLoaderz'Load `Jupyter notebook` (.ipynb) files.F pathr r remove_newliner cL||_||_||_||_||_dS)aInitialize with a path. Args: path: The path to load the notebook from. include_outputs: Whether to include the outputs of the cell. Defaults to False. max_output_length: Maximum length of the output to be displayed. Defaults to 10. remove_newline: Whether to remove newlines from the notebook. Defaults to False. traceback: Whether to return a traceback of the error. Defaults to False. N) file_pathr r r>r )selfr=r r r>r s r"__init__zNotebookLoader.__init__Ps.*.!2,"r.r ctj}t|d5}tj|}dddn #1swxYwYd|dD}jr"t tt|}d t tfd|}dt|i}t|| gS) zLoad documents.utf8)encodingNcJg|] }d|D!S)c"i|] \}}|dv || S))rrrr(r0s r"r3z2NotebookLoader.load...us) X X Xfq!5W0W0WQ0W0W0Wr.)r9)r+r s r"r-z'NotebookLoader.load..ts?    Y X X X X   r.cellsrcFt|jjjS)N)r#r r r )r$rAs r"z%NotebookLoader.load..s#/4/1Gr.r) page_contentmetadata) rr@openjsonloadr>r7mapr*joinr5r)rApfd filtered_datarrLs` r"rOzNotebookLoader.loadks;   !f % % %  ! A                 '      F _m!D!DEEMww "      c!ff%dX>>>??sAA A N)Fr<FF) __name__ __module__ __qualname____doc__rr5rboolintrBrrrOr(r.r"r;r;Ms11 !&!#$ ##CI## #  #  ####6@ h@@@@@@r.r;)rYrNpathlibrtypingrrrlangchain_core.documentsr)langchain_community.document_loaders.baserr8rZr[r5r#r*r;r(r.r"r`s"" ##########------@@@@@@1 1!%1:=1JN11111h s s    <@<@<@<@<@Z<@<@<@<@<@r.