Tools are external functionalities or APIs that can be used by a large language model (LLM) to perform specific actions or retrieve information beyond its inherent capabilities. AIP Agents equipped with tools use a chain-of-thought, which has a slower time to first token and less predictable. Limiting the number of tools assigned to the LLM generally results in a more guided and controlled interaction.
There are five types of tools available:
When deployed in edit mode, view mode, Workshop, or AIP Threads, users can select the "eye" icon to investigate the chain-of-thought reasoning process used to generate a response.