EvalConfig

class langchain.smith.evaluation.config.EvalConfig

Bases: BaseModel

Configuration for a given run evaluator.

Parameters:

evaluator_type (EvaluatorType) – The type of evaluator to use.

get_kwargs()

Get the keyword arguments for the evaluator configuration.

Return type:

Dict[str, Any]

Create a new model by parsing and validating input data from keyword arguments.

Raises ValidationError if the input data cannot be parsed to form a valid model.

param evaluator_type: EvaluatorType [Required]

get_kwargs() → Dict[str, Any]

Get the keyword arguments for the load_evaluator call.

Returns:

The keyword arguments for the load_evaluator call.

Return type:

Dict[str, Any]