Issue

While trying to apply updated scorers to existing experiments, you notice that you need to create new experiments every time a scorer is updated in the UI

Cause

Braintrust allows you to apply updated scorers to existing experiment data without creating new experiments, but this feature may not be immediately obvious in the interface.

Resolution(s)

If you want to apply an updated scorer to existing experiment data

Step 1: Navigate to the specific experiment in the UI

Step 2: Select the desired rows in the experiment

Step 3: Click on "% Score" option

Step 4: Choose the updated scorer you want to apply from the dropdown menu

The updated scorer will be applied to the selected experiment data without needing to create a new experiment.

Otherwise, if you need to score all rows in the experiment

Step 1: Navigate to the specific experiment in the UI

Step 2: Select all rows in the experiment (use Ctrl+A or Cmd+A)

Step 3: Click on "% Score" option

Step 4: Choose the updated scorer you want to apply from the dropdown menu