Ng dZddlmZddlmZmZmZddlmZddl m Z ddl m Z m Z ddlmZddlmZGd d Zd S) !Experiment with different models.) annotations)ListOptionalSequence)BaseLLMPromptTemplate)get_color_mapping print_text)ChainLLMChainc@eZdZdZdddZe ddd ZddZdS)ModelLaboratoryrNchainsSequence[Chain]namesOptional[List[str]]c|D]}t|tstdt|jdkrtd|jt|jdkrtd|j|/t|t|krtd||_dtt|jD}t||_ ||_ dS)zyInitialize with chains to experiment with. Args: chains: list of chains to experiment with. zModelLaboratory should now be initialized with Chains. If you want to initialize with LLMs, use the `from_llms` method instead (`ModelLaboratory.from_llms(...)`)z;Currently only support chains with one input variable, got zz,ModelLaboratory.__init__..-s???!s1vv???) isinstancer ValueErrorlen input_keys output_keysrranger chain_colorsr)selfrrchain chain_ranges r__init__zModelLaboratory.__init__s5   EeU++  A 5#$$)) . +..5$%%** / ,//+  5zzS[[(( !STTT ??uS-=-='>'>??? -k:: r llms List[BaseLLM]promptOptional[PromptTemplate]returncztdgdfd|D}d|D}|||S)a)Initialize with LLMs to experiment with and optional prompt. Args: llms: list of LLMs to experiment with prompt: Optional prompt to use to prompt the LLMs. Defaults to None. If a prompt was provided, it should only have one input variable. N_inputz{_input})input_variablestemplatec2g|]}t|S))llmr.r)rr6r.s rrz-ModelLaboratory.from_llms..>s&CCCs(s6222CCCr c,g|]}t|Srr)rr6s rrz-ModelLaboratory.from_llms..?s***cS***r )rr )clsr,r.rrs ` r from_llmszModelLaboratory.from_llms1s_ >#XJTTTFCCCCdCCC**T***s6''''r textrNonecHtd|dt|jD]y\}}|j|j|}nt |}t |d||}t ||jt |dzdS)a3Compare model outputs on an input text. If a prompt was provided with starting the laboratory, then this text will be fed into the prompt. If no prompt was provided, then the input text is the entire prompt. Args: text: input text to run all models on. zInput:  N)endz )colorr>)print enumeraterrrr runr')r(r:rr)nameoutputs rcomparezModelLaboratory.compareBs /t///000!$+.. L LHAuz%z!}5zz t & & & &YYt__F vT%6s1vv%>F K K K K K L Lr )N)rrrr)r,r-r.r/r0r)r:rr0r;)__name__ __module__ __qualname____doc__r+ classmethodr9rErr rrrsu++>EI(((([( LLLLLLr rN)rI __future__rtypingrrr#langchain_core.language_models.llmsrlangchain_core.prompts.promptr langchain_core.utils.inputr r langchain.chains.baser langchain.chains.llmrrrr rrRs''""""""++++++++++777777888888DDDDDDDD''''''))))))ELELELELELELELELELELr