Getting started

The Logic run panel is great for one-off testing, but for greater confidence in your Logic functions, it is important to test against many inputs. Evaluations makes it easy to build rigorous testing and evaluation suites. Follow the steps below to get started with Evaluations for Logic functions:

  1. Save your Logic function before adding test cases or configuring an evaluation suite.
  2. Select the input(s) you would like to use for your test case in the Logic run panel, and select Add as test case at the bottom. This will generate a test case using the current inputs.

Add test case from Logic run preview panel.

  1. Select the hammer icon on the right toolbar to view all previously created test cases.
  2. Select Run evaluation suite once you have added the desired number of test cases. For additional run-time options, select the cog icon to the right of Run evaluation suite to open the Run configuration dialogue. Here you can choose which version of the Logic you want to use, how many times you want each test to run, or add metadata to your suite run.

Run evaluation suite directly from Logic.

  1. Once your suite is done running, a summary of your run will appear in the Most recent result section. Selecting the eye icon will open a results preview dialogue where you can review the results of each test case. This includes function output, duration, and cost of each test case. The results preview dialogue also allows you to compare two different evaluation suite runs.

Review the results of your evaluation suite runs.