Getting started
Contact your Palantir representative to install this beta product in your enrollment.
This tutorial guides you through a simple workflow to upload a document, interact with the document, and interact with an AIP Agent.
Access AIP Threads
AIP Threads can be accessed from the platform’s workspace navigation bar or by using the quick search shortcuts CMD + J (macOS) or CTRL + J (Windows).
Application interface
The AIP Threads interface can be divided into two main components, numbered left-to-right in the notional screenshot below:
Workflow overview
In a typical AIP Threads workflow, you can begin by selecting a previous conversation or starting a new one on the left panel (1), then using the right panel (2) to interact with documents or AIP Agents. To talk to an AIP Agent, simply select one from the Thread configuration dropdown menu (A) and begin interacting (C). To interact with documents, upload and select documents in the Document card (B) then begin interacting (C).
Left panel
The following section will discuss features configurable in the left panel.
Basic navigation
You can create a new thread, select from existing threads, and delete threads. Note that threads are automatically deleted 24 hours after the last message. Currently, search functionality is limited to searching across the initial message sent in each thread, which appear as titles in the left-hand panel.
Dark mode
You can adjust the visual settings using the option under the thread history.
Minimize left panel
You can minimize the left panel with the following button.
Download
You can download the contents of a conversation (as JSON or PDF) using the Export option.
Upload a document
AIP Threads currently supports native (non-scanned) PDF documents.
To upload a document, follow the steps in the upload document dialog accessed by one of the entry points.
After selecting a location for the document to be saved, upload the documents to be processed.
Follow the progress of the document processing in the top bar.
Once the documents finish processing, you can select the same documents for interaction.
Interact with documents
Select documents to add to the context of a thread via the Recently uploaded section or the document selection dialog accessed by the Select documents option.
You may now start the thread by asking questions of the documents.
With each new message from the user, AIP Threads looks for the five most relevant chunks of all the documents that have been selected. It includes the text from these chunks along with the conversation history so far and provides it to the LLM to respond to your message. Note that this means the LLM does not have access to the entire text of the documents.
Including only the most semantically relevant chunks helps keep the LLM focused, minimize token usage, and handle documents or collections of documents that do not fit within the context window provided by the large language models. Soon, Palantir will offer support for full document text access to further enhance the capabilities of AIP Threads.
The model has been instructed to provide citations to the original documents with each answer, and users should verify the responses of the LLM. The citations should point to the corresponding page number in the PDF document indicating where the information was sourced.
If you would like to change the documents in the context for a thread, either create a new thread and reselect the documents of interest or select Start new thread with current configuration, accessible from the model dropdown menu defined later on this page.
Thread configuration
The following section outlines the different configuration options available.
Model mode
Users can select the LLM used to interact with documents. The models available to you are a subset of those enabled on your stack.
Users can modify the system prompt, which is an instruction for an LLM written in natural language. AIP Threads provides a default prompt to use when asking questions about your documents. If you would like to modify the system prompt, keep in mind that a LLM only has access to the data that you specifically make available to it. In the case of the default AIP Threads experience, this would be just the documents you have added to the thread. This is different from AIP Agent Mode.
Users can modify the model temperature to determine the balance between focused, deterministic output (default value 0) and random output (maximum value 1).
Upgrade a Thread configuration to an AIP Agent
If you find that a particular document or set of documents or configuration of the model and prompting is valuable enough to use again in the future or to share with another user, you may upgrade the thread configuration to an AIP Agent by using the option available in the model configuration dropdown menu.
This will take you to AIP Agent Studio where you can complete the configuration of the agent. Upon publishing in AIP Agent Studio and refreshing AIP Threads, you will be able to interact with it again in AIP Threads.
AIP Agent Mode
To select an AIP Agent to interact with, use the dropdown menu.
If you want your default experience when you start a new thread to be a particular agent, set an agent as default.
Note that AIP Assist Agents do not show up here, and can only be selected from the AIP Assist Panel.