• Documentation
    • Search documentation
    karat

    +

    K

    API Reference ↗
    Use case developmentWorkflow LineageAIP usage metrics and observability

    AIP usage metrics and observability

    The application previously known as Workflow Builder is now called Workflow Lineage.

    To start using Workflow Lineage, open a Workshop application or functions repository and use the keyboard shortcut Command + I (macOS) or Ctrl + I (Windows) to view the relevant Workflow Lineage graph depicting the objects, actions, and functions that back the application.

    AIP usage metrics

    The following sections will help you understand the various AIP usage metrics viewable in Workflow Lineage.

    Model usage coloring

    Example Workflow Lineage with model usage coloring.

    Workflow Lineage allows you to view model metrics for model requests and token usage. There are three types of model usage metrics:

    • Successful: Total successful model requests or tokens used in attempts made by the specified model.
    • Attempted: Total attempts made by the model, including successful and rate-limited attempts.
    • Rate-limited: Total rate-limited attempts made.

    Under Model usage, specify whether you want to view Model requests or Token usage metrics.

    Model requests shows the total number of specified requests on model nodes in your Workflow Lineage.

    Example Workflow Lineage with model requests coloring.

    Token usage shows the number of tokens used for Workshop applications, Automations, or third-party OSDK applications. Token counts on Logic nodes are the token counts used in the Logic application debugger.

    Example Workflow Lineage with token usage coloring.

    Model usage charts

    You can view the token usage or model requests over time for Workshop applications, Automations, and third-party applications (Ontology SDK applications) over time in a line chart by selecting the nodes and opening the Model usage charts panel at the bottom.

    Example Workflow Lineage with token usage coloring.

    To view the specific value for a particular resource, hover over the graph itself. The same filters that are used in the color legend explained above also appear in the charts panel.

    AIP Observability

    Workflow Lineage provides observability features to help you monitor and debug your AIP workflows. You can track execution history, visualize distributed traces, access detailed logs, and analyze performance metrics for your functions, actions, language models, and automations.

    For detailed information about AIP Observability features, view the AIP Observability documentation.