Nge+ dZddlZddlmZddlmZmZmZmZddl m Z m Z ddl m Z ddlmZmZmZddlmZdd lmZmZmZdd lmZmZejeZGd d e ZGd de ZGdde Z dS)z.Tools for interacting with a Power BI dataset.N) perf_counter)AnyDictOptionalTuple)AsyncCallbackManagerForToolRunCallbackManagerForToolRun)BaseTool) ConfigDictFieldmodel_validator)_import_tiktoken)BAD_REQUEST_RESPONSEDEFAULT_FEWSHOT_EXAMPLESRETRY_RESPONSE)PowerBIDataset json_to_mdc eZdZUdZdZeed<dZeed<dZe ed<e d Z e ed <e Zeeed <e ed Zeee fed <dZeed<dZeed<dZeeed<edZedededefdZdedeefdZ d#dedeede defdZ d#dedeede defdZ deee fde!eeee ffd Z"d!ede!e#effd"Z$dS)$QueryPowerBIToolz%Tool for querying a Power BI Dataset. query_powerbinamea Input to this tool is a detailed question about the dataset, output is a result from the dataset. It will try to answer the question using the dataset, and if it cannot, it will ask for clarification. Example Input: "How many rows are in table1?" descriptionN llm_chainTexcludepowerbiexamples)default_factoryr session_cachemax_iterationsioutput_token_limittiktoken_model_namearbitrary_types_allowedbefore)modevaluesreturncp|d}|jjD] }|dvrtd|jj!|S)z8Make sure the LLM chain has the correct input variables.r) tool_inputtablesschemasrzrLLM chain for QueryPowerBITool must have input variables ['tool_input', 'tables', 'schemas', 'examples'], found %s)promptinput_variables ValueError)clsr(rvars b/var/www/html/ai-engine/env/lib/python3.11/site-packages/langchain_community/tools/powerbi/tool.py"validate_llm_chain_input_variablesz3QueryPowerBITool.validate_llm_chain_input_variables.s] ;' #3  CIII I$4J  r+c2||jvrdS|j|S)zCheck if the input is present in the cache. If the value is a bad request, overwrite with the escalated version, if not present return None.N)r)selfr+s r3 _check_cachezQueryPowerBITool._check_cache=s% T/ / /4!*--r5 run_managerkwargsc ||x}rtd|||S td||j||j|j|j |r| nd}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j|}t} td |td | |z d ||\} } | d | vrd |j |<|j |S|dd} | r;| |jkr0|t'j||| || dzS| r| nt+j| |j |<|j |S):Execute the query, return the results or an error message.Found cached result for %s: %s%Running PBI Query Tool with input: %sNr+r,r-r callbacksError on call to LLM: I cannot answer thisz PBI Query: %scommandPBI Result: %sPBI Query duration: 0.6f TokenExpiredzCAuthentication token expired or invalid, please try reauthenticate. iterationsrr+queryerrorr+r9rIrL)r8loggerdebuginforpredictrget_table_names get_schemasr get_child Exceptionrrrun _parse_outputgetr!_runrformatr r7r+r9r:cacherKexc start_time pbi_resultend_timeresultrLrIs r3r[zQueryPowerBITool._runFs%%j11 15  LL9:u M M ML 2 KK? L L LN**%|3355 00225@J+//111d +EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 $e,,,!^^ \%%e%44 >> %z222 HHz,AHHHIII**:66   5!8!8U  z *%j1 1ZZ a00  Z$"55599)0)e(%>   JFF"6"=E"J"J"J :&!*--sBB;; C)C$C)$C)cK||x}r!td|||dS td||j||j|j|j |r| ndd{V}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j| d{V}t} td |td | |z d ||\} } | d | vsd| vrd|j |<|j |S|dd} | rA| |jkr6|t'j||| || dzd{VS| r| nt+j| |j |<|j |S)r<r=z3, from cache, you have already asked this question.r>Nr?rArBz PBI Query: %srCrErFrGrH TokenErrorzkAuthentication token expired or invalid, please try to reauthenticate or check the scope of the credential.rIrrJrMrNrO)r8rPrQrRrapredictrrTrUrrVrWrrarunrYrZr!_arunrr\rr]s r3rhzQueryPowerBITool._arun|s%%j11 15 Q LL9:u M M MPPP P 2 KK? L L L.11%|3355 00225@J+//111d 2EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 OU+++!^^ <,,U,;;;;;;;; >> %z222 HHz,AHHHIII**:66   .E"9"9\U=R=R}  z *%j1 1ZZ a00  Z$"555)0)e(%> $  JFF"6"=E"J"J"J :&!*--sB C C4C/)C4/C4racd|vr|ddddd}t|dkrtddSt|}||\}}|rd|d|jd d fS|d fSd |vrFd |d vr2d |d d vr"d |d d d ddfSd |d fSd |fS)z2Parse the output of the query to a markdown table.resultsrr,rowsz%0 records in result, query was valid.)Nz^0 rows returned, this might be correct, but please validate if all filter values were correct?z[Result too large, please try to be more specific or use the `TOPN` function. The result is z tokens long, the limit is z tokens.NrLz pbi.errordetailsdetail)lenrPrRr_result_too_larger")r7rarkrctoo_longlengths r3rYzQueryPowerBITool._parse_outputsE  " "i(+H5a8@D4yyA~~ CDDD %%F#55f== Hf wrxwwVZVmwww4<  j z'222G!4[!AAAZ0=iHKHUUUG,, ,Zr5rcc|jrrt}||j}t||}t d|||jk|fSdS)z!Tokenize the output of the query.zResult length: %s)Fr)r#rencoding_for_modelrnencoderPrRr")r7rc tiktoken_encodingrqs r3roz"QueryPowerBITool._result_too_largest  # <(**I 33D4LMMH0011F KK+V 4 4 4D33V; ;xr5N)%__name__ __module__ __qualname____doc__rstr__annotations__rrrr rrrrrdictrrr!intr"r#r model_configr classmethodr4r8r r[rrhrrYboolror5r3rrsm//D#K Is#eD111G^1116Hhsm666$)E$$M$M$MM4S>MMMNC"""")-#---: $L_(###      [$# .s.x}....<@4.4.4.784. 4. 4.4.4.4.rAE4.4.4.<=4. 4. 4.4.4.4.l sCx. x}hsm+ ,    <dCi0@r5rceZdZUdZdZeed<dZeed<edZ e ed<e d Z dd ed e ed efdZ dd ed e ed efdZd S)InfoPowerBIToolz2Tool for getting metadata about a PowerBI Dataset.schema_powerbirz Input to this tool is a comma-separated list of tables, output is the schema and sample rows for those tables. Be sure that the tables actually exist by calling list_tables_powerbi first! Example Input: "table1, table2, table3" rTrrr$Nr+r9r)c\|j|dS)z4Get the schema for tables in a comma-separated list., )rget_table_infosplitr7r+r9s r3r[zInfoPowerBITool._runs( |**:+;+;D+A+ABBBr5clK|j|dd{VS)Nr)raget_table_inforrs r3rhzInfoPowerBITool._aruns> \11*2B2B42H2HIIIIIIIIIr5rwrxryrzr{rr|r}rr rrr rrr r[rrhrr5r3rrs<< D#   K $eD111G^111: $L<@CCC78C CCCCAEJJJ<=J JJJJJJr5rceZdZUdZdZeed<dZeed<edZ e ed<e d Z dd e ed e ed efdZ dd e ed e ed efdZd S)ListPowerBIToolzTool for getting tables names.list_tables_powerbirzUInput is an empty string, output is a comma separated list of tables in the database.rTrrr$Nr+r9r)cZd|jSzGet the names of the tables.rjoinrrTrs r3r[zListPowerBITool._runs$ yy5577888r5c^Kd|jSrrrs r3rhzListPowerBITool._aruns( yy5577888r5)NNrrr5r3rrs((%D#%%%nKnnn#eD111G^111: $L %);?99SM9789 9999%)@D99SM9<=9 999999r5r)!r{loggingtimertypingrrrrlangchain_core.callbacksrr langchain_core.toolsr pydanticr r r &langchain_community.chat_models.openair(langchain_community.tools.powerbi.promptrrr%langchain_community.utilities.powerbirr getLoggerrxrPrrrrr5r3rs44------------*)))))7777777777CCCCCC MLLLLLLL  8 $ $xDJJJJJhJJJ@99999h99999r5