Skip to contents

Mark a trial as completed with evaluation results.

Usage

complete_trial(trial, eval_result, compiled_artifact_ref = NULL, notes = NULL)

Arguments

trial

A trial record created by create_trial().

eval_result

An EvalResult object from eval_program().

compiled_artifact_ref

Optional compiled module to persist as the best safe program artifact when this trial wins.

notes

Optional additional notes.

Value

The updated trial record with status "completed".

Examples

if (FALSE) { # \dontrun{
program <- module(signature("question -> answer"))
data <- data.frame(question = "2 + 2?", answer = "4")
chat <- ellmer::chat_openai()
result <- eval_program(program, data, metric_exact_match(), .llm = chat)
trial <- create_trial("example")
complete_trial(trial, result)
} # }