AnalyzerΒΆ

DeepOBS uses the analyzer class to get meaning full outputs from the results created by the runners. This includes:

  • Getting the best settings (e.g. best learning rate) for an optimizer on a specific test problem.
  • Plotting the learning_rate sensitivity for multiple optimizers on a test problem.
  • Plotting all performance metrics of the whole benchmark set.
  • Returning the overall performance table for multiple optimizers.

The analyzer can return those outputs as matplotlib plots or .tex files for direct inclusion in academic publications.

DeepOBS also includes a convenience script using this analyzer class for these most used cases, see Plot Results

Analyzer