Extending the Benchmark Tool

You can extend the benchmark tool in multiple ways. Benchmarks define collections of tasks on which to evaluate AutoML frameworks. Constraints specify the resource constraints forwarded to the AutoML framework, such as a time or memory limit. Finally, it is possible to add AutoML frameworks or to use an integrated AutoML framework with non-default configuration.