o Age+@sdZddlZddlmZddlmZmZmZmZddl m Z m Z ddl m Z ddlmZmZmZddlmZdd lmZmZmZdd lmZmZeeZGd d d e ZGd dde ZGddde Z dS)z.Tools for interacting with a Power BI dataset.N) perf_counter)AnyDictOptionalTuple)AsyncCallbackManagerForToolRunCallbackManagerForToolRun)BaseTool) ConfigDictFieldmodel_validator)_import_tiktoken)BAD_REQUEST_RESPONSEDEFAULT_FEWSHOT_EXAMPLESRETRY_RESPONSE)PowerBIDataset json_to_mdc @sdeZdZUdZdZeed<dZeed<dZe ed<e dd Z e ed <e Zeeed <e edd Zeee fed <dZeed<dZeed<dZeeed<eddZeddededefddZdedeefddZ d)dedeede defdd Z d)dedeede defd!d"Z d#eee fde!eeee ffd$d%Z"d&ede!e#effd'd(Z$dS)*QueryPowerBIToolz%Tool for querying a Power BI Dataset. query_powerbinamea Input to this tool is a detailed question about the dataset, output is a result from the dataset. It will try to answer the question using the dataset, and if it cannot, it will ask for clarification. Example Input: "How many rows are in table1?" descriptionN llm_chainTexcludepowerbiexamples)default_factoryr session_cachemax_iterationsioutput_token_limittiktoken_model_namearbitrary_types_allowedbefore)modevaluesreturncCs0|d}|jjD] }|dvrtd|jjq|S)z8Make sure the LLM chain has the correct input variables.r) tool_inputtablesschemasrzrLLM chain for QueryPowerBITool must have input variables ['tool_input', 'tables', 'schemas', 'examples'], found %s)promptinput_variables ValueError)clsr&rvarr0m/var/www/html/development/chatbot/venv/lib/python3.10/site-packages/langchain_community/tools/powerbi/tool.py"validate_llm_chain_input_variables.s z3QueryPowerBITool.validate_llm_chain_input_variablesr(cCs||jvrdS|j|S)zCheck if the input is present in the cache. If the value is a bad request, overwrite with the escalated version, if not present return None.N)r)selfr(r0r0r1 _check_cache=s  zQueryPowerBITool._check_cache run_managerkwargsc Ks||}rtd|||Sz td||jj||j|j|j |r+| ndd}Wnt yO}zd||j |<|j |WYd}~Sd}~ww|dkr^||j |<|j |Std|t }|jj|d}t } td |td | |d ||\} } | durd | vrd |j |<|j |S|dd} | r| |jkr|jtj||| d|| ddS| r| ntj| d|j |<|j |S):Execute the query, return the results or an error message.Found cached result for %s: %s%Running PBI Query Tool with input: %sNr(r)r*r callbacksError on call to LLM: I cannot answer thisz PBI Query: %scommandPBI Result: %sPBI Query duration: 0.6f TokenExpiredzCAuthentication token expired or invalid, please try reauthenticate. iterationsrr(queryerrorr(r5rDrG)r4loggerdebuginforpredictrget_table_names get_schemasr get_child Exceptionrrrun _parse_outputgetr_runrformatr r3r(r5r6cacherFexc start_time pbi_resultend_timeresultrGrDr0r0r1rVFsV          zQueryPowerBITool._runc s||}rtd|||dSz#td||jj||j|j|j |r/| nddIdH}Wnt yV}zd||j |<|j |WYd}~Sd}~ww|dkre||j |<|j |Std|t }|jj|d IdH}t } td |td | |d ||\} } | durd | vsd| vrd|j |<|j |S|dd} | r| |jkr|jtj||| d|| ddIdHS| r| ntj| d|j |<|j |S)r7r8z3, from cache, you have already asked this question.r9Nr:r<r=z PBI Query: %sr>r@rArBrC TokenErrorzkAuthentication token expired or invalid, please try to reauthenticate or check the scope of the credential.rDrrErHrIrJ)r4rKrLrMrapredictrrOrPrrQrRrrarunrTrUr_arunrrWrrXr0r0r1rb|sX           zQueryPowerBITool._arunr\cCsd|vr:|ddddd}t|dkrtddSt|}||\}}|r6d|d|jd d fS|d fSd |vr`d |d vrZd |d d vrZd |d d d ddfSd |d fSd |fS)z2Parse the output of the query to a markdown table.resultsrr)rowsz%0 records in result, query was valid.)Nz^0 rows returned, this might be correct, but please validate if all filter values were correct?z[Result too large, please try to be more specific or use the `TOPN` function. The result is z tokens long, the limit is z tokens.NrGz pbi.errordetailsdetail)lenrKrMr_result_too_larger )r3r\rdr^too_longlengthr0r0r1rTs$    zQueryPowerBITool._parse_outputr^cCsD|jr t}||j}t||}td|||jk|fSdS)z!Tokenize the output of the query.zResult length: %s)Fr)r!r encoding_for_modelrgencoderKrMr )r3r^ tiktoken_encodingrjr0r0r1rhs  z"QueryPowerBITool._result_too_largeN)%__name__ __module__ __qualname____doc__rstr__annotations__rrrr rrrrrdictrrrintr r!r model_configr classmethodr2r4rrVrrbrrTboolrhr0r0r0r1rs`         9 6  rc@seZdZUdZdZeed<dZeed<eddZ e ed<e dd Z dd ed e ed efddZ dd ed e ed efddZd S)InfoPowerBIToolz2Tool for getting metadata about a PowerBI Dataset.schema_powerbirz Input to this tool is a comma-separated list of tables, output is the schema and sample rows for those tables. Be sure that the tables actually exist by calling list_tables_powerbi first! Example Input: "table1, table2, table3" rTrrr"Nr(r5r'cCs|j|dS)z4Get the schema for tables in a comma-separated list., )rget_table_infosplitr3r(r5r0r0r1rVszInfoPowerBITool._runcs|j|dIdHS)Nr})raget_table_inforrr0r0r1rbszInfoPowerBITool._arunrorprqrrrsrrtrurr rrr rxrrrVrrbr0r0r0r1r{s0     r{c@seZdZUdZdZeed<dZeed<eddZ e ed<e dd Z dd e ed e ed efddZ dd e ed e ed efddZd S)ListPowerBIToolzTool for getting tables names.list_tables_powerbirzUInput is an empty string, output is a comma separated list of tables in the database.rTrrr"Nr(r5r'cCsd|jSzGet the names of the tables.r}joinrrOrr0r0r1rVszListPowerBITool._runcsd|jSrrrr0r0r1rbszListPowerBITool._arun)NNrr0r0r0r1rs4     r)!rsloggingtimertypingrrrrlangchain_core.callbacksrrlangchain_core.toolsr pydanticr r r &langchain_community.chat_models.openair (langchain_community.tools.powerbi.promptrrr%langchain_community.utilities.powerbirr getLoggerrprKrr{rr0r0r0r1s    C