DeepOBS uses the analyzer class to get meaning full outputs from the results created by the runners. This includes:
- Getting the best settings (e.g. best
learning rate) for an optimizer on a specific test problem.
- Plotting the
learning_ratesensitivity for multiple optimizers on a test problem.
- Plotting all performance metrics of the whole benchmark set.
- Returning the overall performance table for multiple optimizers.
The analyzer can return those outputs as matplotlib plots or
.tex files for
direct inclusion in academic publications.
DeepOBS also includes a convenience script using this analyzer class for these most used cases, see Plot Results