Project: HpBandSter (GitHub Link)

HpBandSter-master
- hpbandster
  - examples
    - plot_example_7_interactive_plot.py
    - commons.py
    - example_5_mnist.py
    - example_1_local_sequential.py
    - README.txt
    - example_3_local_parallel_processes.py
    - plot_example_6_analysis.py
    - example_5_run
      - configs.json
      - results.json
    - example_4_cluster.py
    - example_8_mnist_continued.py
    - example_5_keras_worker.py
    - __init__.py
    - example_2_local_parallel_threads.py
    - example_5_pytorch_worker.py
  - workers
    - hpolibbenchmark.py
    - __init__.py
  - __init__.py
  - utils.py
  - visualization.py
  - core
    - nameserver.py
    - master.py
    - base_iteration.py
    - base_config_generator.py
    - result.py
    - __init__.py
    - dispatcher.py
    - worker.py
  - optimizers
    - bohb.py
    - config_generators
      - random_sampling.py
      - bohb.py
      - kde.py
      - __init__.py
      - lcnet.py
      - h2bo.py
    - kde
      - __init__.py
      - mvkde.py
      - kernels.py
    - randomsearch.py
    - __init__.py
    - hyperband.py
    - learning_curve_models
      - arif.py
      - __init__.py
      - lcnet.py
      - base.py
    - lcnet.py
    - h2bo.py
    - iterations
      - successiveresampling.py
      - successivehalving.py
      - __init__.py
- .nojekyll
- codecov.yml
- LICENSE
- CONTRIBUTING.md
- setup.py
- .travis.yml
- README.md
- tests
  - test_utils.py
  - test_config_generators.py
  - test_kde.py
  - test_worker.py
  - __init__.py
  - test_kernels.py
  - test_result.py
- .gitignore
- docs
  - Makefile
  - source
    - optimizers.rst
    - best_practices.rst
    - faq.rst
    - core_components.rst
    - advanced_examples.rst
    - license.rst
    - quickstart.rst
    - core
      - config_generator.rst
      - visualization.rst
      - dispatcher.rst
      - nameserver.rst
      - worker.rst
      - result.rst
      - master.rst
      - iteration.rst
    - index.rst
    - conf.py
    - contact.rst
    - optimizers
      - hyperband.rst
      - how_to_extend.rst
      - randomsearch.rst
      - bohb.rst
    - _templates
      - layout.html
  - build
    - html
      - .nojekyll
      - _sources
        index.rst.txt
        auto_examples
        index.rst.txt
        commons.rst.txt
        example_5_pytorch_worker.rst.txt
        example_3_warmstarting_visualization.rst.txt
        example_1_local_sequential.rst.txt
        example_8_mnist_continued.rst.txt
        plot_example_6_analysis.rst.txt
        plot_example_7_interactive_plot.rst.txt
        example_3_local_parallel_processes.rst.txt
        example_5_mnist.rst.txt
        example_5_keras_worker.rst.txt
        example_2_local_parallel_threads.rst.txt
        example_4_cluster.rst.txt
        license.rst.txt
        contact.rst.txt
        quickstart.rst.txt
        optimizers.rst.txt
        faq.rst.txt
        advanced_examples.rst.txt
        best_practices.rst.txt
        core
        config_generator.rst.txt
        nameserver.rst.txt
        dispatcher.rst.txt
        result.rst.txt
        iteration.rst.txt
        master.rst.txt
        visualization.rst.txt
        worker.rst.txt
        optimizers
        how_to_extend.rst.txt
        bohb.rst.txt
        randomsearch.rst.txt
        hyperband.rst.txt
        core_components.rst.txt
      - searchindex.js
      - auto_examples
        example_4_cluster.html
        example_2_local_parallel_threads.html
        commons.html
        example_3_local_parallel_processes.html
        plot_example_6_analysis.html
        example_3_warmstarting_visualization.html
        example_1_local_sequential.html
        plot_example_7_interactive_plot.html
        example_5_mnist.html
        index.html
        example_5_pytorch_worker.html
        example_5_keras_worker.html
        example_8_mnist_continued.html
      - advanced_examples.html
      - core_components.html
      - best_practices.html
      - _modules
        hpbandster
        visualization.html
        core
        base_config_generator.html
        nameserver.html
        base_iteration.html
        dispatcher.html
        result.html
        worker.html
        master.html
        optimizers
        randomsearch.html
        hyperband.html
        bohb.html
        index.html
      - _images
      - _downloads
        auto_examples_python.zip
        example_4_cluster.ipynb
        plot_example_7_interactive_plot.py
        commons.py
        example_2_local_parallel_threads.ipynb
        example_5_mnist.py
        example_1_local_sequential.py
        example_5_mnist.ipynb
        example_3_local_parallel_processes.py
        plot_example_6_analysis.py
        example_5_pytorch_worker.ipynb
        example_8_mnist_continued.ipynb
        commons.ipynb
        example_3_local_parallel_processes.ipynb
        example_4_cluster.py
        example_8_mnist_continued.py
        example_5_keras_worker.py
        auto_examples_jupyter.zip
        example_2_local_parallel_threads.py
        example_1_local_sequential.ipynb
        example_3_warmstarting_visualization.ipynb
        example_5_pytorch_worker.py
        plot_example_7_interactive_plot.ipynb
        plot_example_6_analysis.ipynb
        example_3_warmstarting_visualization.py
        example_5_keras_worker.ipynb
      - faq.html
      - .buildinfo
      - objects.inv
      - genindex.html
      - optimizers.html
      - contact.html
      - py-modindex.html
      - quickstart.html
      - core
        nameserver.html
        visualization.html
        iteration.html
        dispatcher.html
        result.html
        worker.html
        master.html
        config_generator.html
      - index.html
      - optimizers
        how_to_extend.html
        randomsearch.html
        hyperband.html
        bohb.html
      - search.html
      - license.html
      - _static
        ajax-loader.gif
        jquery.js
        basic.css
        pygments.css
        searchtools.js
        documentation_options.js
        doctools.js
        fonts
        fontawesome-webfont.woff2
        fontawesome-webfont.woff
        fontawesome-webfont.eot
        Lato
        lato-bold.woff2
        lato-bolditalic.woff2
        lato-italic.woff2
        lato-regular.woff2
        RobotoSlab
        roboto-slab-v7-bold.woff2
        roboto-slab-v7-regular.eot
        roboto-slab-v7-bold.ttf
        roboto-slab-v7-bold.eot
        roboto-slab-v7-regular.woff
        roboto-slab-v7-bold.woff
        roboto-slab-v7-regular.ttf
        roboto-slab-v7-regular.woff2
        fontawesome-webfont.ttf
        websupport.js
        underscore-1.3.1.js
        js
        theme.js
        modernizr.min.js
        underscore.js
        gallery.css
        css
        badge_only.css
        theme.css
  - .nojekyll
  - index.html

HpBandSter

a distributed Hyperband implementation on Steroids

This python 3 package is a framework for distributed hyperparameter optimization. It started out as a simple implementation of Hyperband (Li et al. 2017), and contains an implementation of BOHB (Falkner et al. 2018)

How to install

We try to keep the package on PyPI up to date. So you should be able to install it via:

pip install hpbandster

If you want to develop on the code you could install it via:

python3 setup.py develop --user

Documentation

The documentation is hosted on github pages: https://automl.github.io/HpBandSter/ It contains a quickstart guide with worked out examples to get you started in different circumstances. Check it out if you are interest in applying one of the implemented optimizers to your problem.

We have also written a blogpost showcasing the results from our ICML paper.