Create a Custom Metric

Wrapper for creating custom metric functions with consistent interface and error handling. The function may return one logical or numeric score, or list(score = , feedback = ) for feedback-aware optimization.

Usage

metric_custom(fn, name = NULL)

Arguments

fn

A two-argument metric function returning one logical/numeric score or list(score = , feedback = ).

name

Optional name for the metric (for debugging)

Value

A metric function with enhanced error handling

Examples

# Custom length comparison
length_metric <- metric_custom(function(pred, exp) {
  nchar(as.character(pred)) == nchar(as.character(exp))
}, name = "length_match")

# Custom scoring function
score_metric <- metric_custom(function(pred, exp) {
  # Return value between 0 and 1
  min(nchar(pred) / nchar(exp), 1)
})