Setting Analyzer

class deepobs.analyzer.analyze_utils.SettingAnalyzer(path, sett, metric, testproblem, conv_perf)[source]

DeepOBS analyzer class for a setting (a hyperparameter setting).

Parameters:
  • path (str) -- Path to the parent folder of the setting folder (i.e. the optimizer folder).
  • sett (str) -- Name of the setting (folder).
  • metric (str) -- Metric to use for this test problem. If available this will be test_accuracies, otherwise test_losses.
  • testproblem (str) -- Name of the test problem this setting (folder) belongs to.
  • conv_perf (float) -- Convergence performance of the test problem this setting (folder) belongs to.
name

Name of the setting (folder).

Type:str
metric

Metric to use for this test problem. If available this will be test_accuracies, otherwise test_losses.

Type:str
testproblem

Name of the test problem this setting (folder) belongs to.

Type:str
conv_perf

Convergence performance for this test problem.

Type:float
aggregate

Instance of the AggregateRun class for all runs with this setting.

Type:AggregateRun