Evaluator

class coba.primitives.Evaluator

An evaluator for learners in environments.

Methods

abstract evaluate(environment: Environment | None, learner: Learner | None) → Mapping[Any, Any] | Iterable[Mapping[Any, Any]]

Evaluate the learner on the given interactions.

Parameters:

• environment – The Environment we want to evaluate against.

• learner – The Learner that we wish to evaluate.

Returns:

Evaluation results

Attributes

params

Parameters describing the evaluator (used for descriptive purposes only).

Remarks:

These will become columns in the evaluators table of experiment results.