Ng6:dZddlmZddlZddlmZmZmZmZm Z m Z m Z m Z ddl mZddlmZddlmZddlmZdd lmZdd lmZdd lmZdd lmZdd lmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%ddl&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2ddl3m4Z4Gddee#Z5dddddDdZ6dEd"Z7dFd&Z8de9ee9e"d'dd(dGd6Z:ed7d8d9:de9ee9e"d'dfdHd?Z;de9ee9e"d'dd'd@dIdCZz5StructuredQueryOutputParser.parse..>s)HHHDAqa<6G6G1a6G6G6Gz Parsing text z raised following error: r4) rlenr)getpopritems Exceptionr )selfr* expected_keysparseder8s @r9parsez!StructuredQueryOutputParser.parse0s@ $h/M777L24GGFg&#fWo*>*>!*C*C"%wh;..fX6F.#'x  #'>>&2B#C#Cx ::g&& * 7D)))"HHHHFLLNNHHH    'FFF1FF  sC C C2C--C2NFallowed_comparatorsOptional[Sequence[Comparator]]allowed_operatorsOptional[Sequence[Operator]]allowed_attributesOptional[Sequence[str]] fix_invalidboolcd|r dfd }ntj}||S) z Create a structured query output parser from components. Args: allowed_comparators: allowed comparators allowed_operators: allowed operators Returns: a structured query output parser raw_filterr+r,Optional[FilterDirective]ctttt|}t |}|SNrFrHrJ)r rrrrEfix_filter_directive)rOr/fixedrJrFrHs r9r)z>StructuredQueryOutputParser.from_components..ast_parseZsPh79K9KJ9W9WXX,(;&7'9   r;rS)r))rOr+r,rP)rrE)clsrFrHrJrLr)s ``` r9from_componentsz+StructuredQueryOutputParser.from_componentsEsx&           #$7"3#5  sY''''r;)r*r+r,r)NNNF) rFrGrHrIrJrKrLrMr,r()__name__ __module__ __qualname____doc____annotations__rE classmethodrWr4r;r9r(r(*ss77S*?C:>6:! $($($($([$($($(r;r(rSr/rPrFrGrHrIrJrKr,cssr|s|St|trr |jvrdSr |jvrdS|St|trvr |jvrdSfd|jD}|sdSt|dkr'|jtj tj fvr|dSt |j|S|S)ahFix invalid filter directive. Args: filter: Filter directive to fix. allowed_comparators: allowed comparators. Defaults to all comparators. allowed_operators: allowed operators. Defaults to all operators. allowed_attributes: allowed attributes. Defaults to all attributes. Returns: Fixed filter directive. Nc `g|]*}|ttt|+SrR)r rrT)r5argrJrFrHs r9 z(fix_filter_directive..sU     $(;&7'9   r;r)operator arguments) isinstancer comparator attributerrcrdr<rANDOR)r/rFrHrJargss ``` r9rTrTms@&!%$5%9K% % FJ ' '   6#4jsondumpsreplace)rk info_dictsii_dicts r9_format_attribute_infor}soJ 00a)/ 6::f%%&& :j + + + 3 3C > > F FsD Q QQr;input_output_pairsSequence[Tuple[str, dict]] List[dict]cg}t|D]d\}\}}tj|ddddd}|dz||d}||e|S) zConstruct examples from input-output pairs. Args: input_output_pairs: Sequence of input-output pairs. Returns: List of examples. rorprrrsrtrurb)r{ user_querystructured_request) enumeraterwrxryappend)r~examplesr{_inputoutputrexamples r9construct_examplesrsH();<< ! ! FF Jva ( ( ( 0 0d ; ; C CC N N Q "4       Or;FrrFrH enable_limit schema_promptdocument_contentsattribute_inforOptional[Sequence]Sequence[Comparator]Sequence[Operator]rrMrOptional[BasePromptTemplate]kwargsrrc |rtnt}|p|}t|} |d|d|} |rnt |dt rSt|}t} tj| || } tjt|dz} nU|p|rtnt}t} tj| } t!jt|dz|| } t#d t%|| d g| | d |S) a#Create query construction prompt. Args: document_contents: The contents of the document to be queried. attribute_info: A list of AttributeInfo objects describing the attributes of the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. allowed_operators: Sequence of allowed operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A prompt template that can be used to construct queries. z | )rFrHr)schemacontent attributesrb)r{)r)r{rrr.)rexample_promptinput_variablessuffixprefixr4)r#rr}formatjoinretuplerr%r"r$r<r!rr rrrlist)rrrrFrHrrrdefault_schema_prompt attribute_strrrrrs r9get_query_constructor_promptrs}:%1K  6K":%:M*>::M  ! !!JJ':;;**%677"F Jx{E22 %h//6(/#4   ,2S]]Q5FGGG #/ E  5E (&f555&(mma):}    ! h%        r;z0.2.13load_query_constructor_runnablez1.0)since alternativeremovalllmrOptional[List]rc t|||||||} g} |D]9} | t| tr| jn| d:t ||| } | | _td|| | d|S)aSLoad a query constructor chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: The contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. **kwargs: Arbitrary named params to pass to LLMChain. Returns: A LLMChain that can be used to construct queries. rrnrS)rprompt output_parserr4) rrrer&rnr(rWrr) rrrrrFrHrrrrrJainfors r9load_query_constructor_chainrsD*/+!#F  !!$UM:: MEJJf     0??/+-@M )F  RF- R R6 R RRr;)rrFrHrrrLrLrc t||f|||||d| } g} |D]9} | t| tr| jn| d:t ||| |} | |z| zS)aLoad a query constructor runnable chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: Description of the page contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all Comparators. allowed_operators: Sequence of allowed operators. Defaults to all Operators. enable_limit: Whether to enable the limit operator. Defaults to False. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. fix_invalid: Whether to fix invalid filter directives by ignoring invalid operators, comparators and attributes. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A Runnable that can be used to construct queries. rrn)rFrHrJrL)rrrer&rnr(rW)rrrrrFrHrrrLrrrJrrs r9rr?sD* /+!#     F  !!$UM:: MEJJf     0??/+- @M C<- ''r;) r/rPrFrGrHrIrJrKr,rP)rkrlr,r+)r~rr,r)rr+rrlrrrFrrHrrrMrrrrr,r)rrrr+rrlrrrFrrHrrrMrrrrr,r)rrrr+rrlrrrFrrHrrrMrrrLrMrrr,r)=r[ __future__rrwtypingrrrrrr r r langchain_core._apir langchain_core.exceptionsr langchain_core.language_modelsrlangchain_core.output_parsersr"langchain_core.output_parsers.jsonrlangchain_core.promptsrlangchain_core.prompts.few_shotrlangchain_core.runnablesrlangchain_core.structured_queryrrrrrrlangchain.chains.llmr)langchain.chains.query_constructor.parserr)langchain.chains.query_constructor.promptrrrrr r!r"r#r$r%)langchain.chains.query_constructor.schemar&r(rTr}rrrrrr4r;r9rsFF"""""" NNNNNNNNNNNNNNNNNNNN******;;;;;;<<<<<<::::::LLLLLL555555AAAAAA------*)))))@@@@@@                        DCCCCC@(@(@(@(@("2?"C@(@(@(L;?6:26 777777tRRRR6$(05j0A0A,1E(OO26<<<<<<~  1  $05j0A0A,1E(OO262S2S2S2S  2St$(05j0A0A,1E(OO267(7(7(7(7(7(7(7(r;