Retrieval context
An AIP Agent with retrieval context will deterministically fetch information from data sources with every new user message to pass into the LLM. This is compatible with a single-completion prompting strategy which has a faster time to first token.
You may configure your agent with one of two types of retrieval context:
Ontology context
Ontology context allows users to perform semantic search over an object set with each message sent and provides the results of the search as additional context for the LLM to use in its answer. Ontology context differs from the ontology semantic search tool as it is not applied conditionally (the tool may not be used if the LLM decides it is not relevant) and the tool offers an additional ability to call a function to return the semantically similar objects instead of configuring a vector property.
After selecting Ontology context, configure the object set you would like to perform a semantic search across.
We currently only support an object set of one object type and that object type must contain a vector property on which to perform the semantic search. That object set could be an entire object type ("Static input") or an object set application variable ("Application variable").
The max number of objects passed into the LLM as context can be configured with a value ranging from 1 to 100 with a default value of 5. You can also configure from 1 to 5 content properties to pass into the LLM as additional context.
During a session, we render the content properties with links to the object in Object Explorer. This is visible in the collapsible context message between the sent message and received message.
Document context
Document context allows users to include relevant text from documents with each message sent to the LLM. Documents can be selected and included in the configuration of an AIP Agent in the same way they are added to a conversation in AIP Threads. Select Document context > Select documents or pick from Recently uploaded documents.
