Evaluator (Core) [50%]#
- class Evaluator(Experiment)[source]#
Bases:
Configurable
DescriptionThe Evaluator evaluates the results of an experiment.- Parameters:
experiment (Experiment) – The experiment to be evaluated
- experiment: Experiment = Field(name=None,type=None,default=<dataclasses._MISSING_TYPE object>,default_factory=<dataclasses._MISSING_TYPE object>,init=False,repr=False,hash=None,compare=True,metadata=mappingproxy({}),_field_type=None)#
- register(self, experiment) None [source]#
- DescriptionRegisters a new experiment as the one to be evaluated.
- Parameters:
experiment (Experiment) – The experiment to be evaluated
- class LogingEvaluator(*args: Any, **kwargs: Any)[source]#
Bases:
Evaluator
LoggingEvaluator(experiment) | Description | Logs the evaluation of the experiment into a “./eval/log” folder
- Parameters:
experiment (Experiment) – The experiment to be evaluated
- folder: str = 'log'#
- property iteration#
- DescriptionReturns the current iteration of the experiment.
- Returns:
Current iteration of the experiment
- Return type:
int
- path = './eval'#
- register(self, experiment) None [source]#
- DescriptionRegisters the experiment as the one to be evaluated and creates the logging folders.
- Parameters:
experiment (Experiment) – The experiment to be evaluated
- root_path: str = './eval'#