Project: pcocc (GitHub Link)

pcocc-master
- AUTHORS
- .coveragerc
- dist
  - bdist_rpm_post
  - bdist_rpm_install
  - bdist_rpm_postun
  - pkeyd.service
  - bdist_rpm_macros
  - bdist_rpm_preun
- helpers
  - examples
    - gen_slurm.sh
- LICENSE
- agent
  - src
    - pcocc-agent.go
    - serial
      - serial.go
    - command
      - command.go
    - agent_protocol
      - agent.pb.go
  - pcocc-agent.service
  - Makefile
  - pcocc-agent.spec
- lib
  - pcocc
    - DeprecatedNetworks.py
    - ObjectStore.py
    - Resources.py
    - NetUtils.py
    - Cluster.py
    - Hypervisor.py
    - Networks.py
    - Agent.py
    - EthNetwork.py
    - agent.proto
    - Config.py
    - GenPCINetwork.py
    - Singleton.py
    - Templates.py
    - Backports.py
    - Batch.py
    - Image.py
    - Error.py
    - Plot.py
    - Tbon.py
    - __init__.py
    - gen_proto.sh
    - Misc.py
    - IBNetwork.py
    - scripts
      - cmd.py
      - click
        testing.py
        decorators.py
        exceptions.py
        formatting.py
        _termui_impl.py
        termui.py
        LICENSE
        _bashcomplete.py
        _textwrap.py
        _compat.py
        __init__.py
        utils.py
        parser.py
        core.py
        types.py
      - Shine
        TextTable.py
        __init__.py
      - __init__.py
    - BridgedNetwork.py
    - agent_pb2_grpc.py
    - HostIBNetwork.py
    - agent_pb2.py
- plugins
  - slurm
    - vm-setup.lua
- setup.py
- setup.cfg
- README.md
- tests
  - test_idallocator.py
  - test_networks.py
  - test_image.py
  - test_networks
    - networks_syntax.yaml
    - networks_unknown.yaml
    - networks_all.yaml
    - networks_badname.yaml
    - networks_addparam.yaml
    - networks_toplevel.yaml
  - test_templates
    - image_rev
      - image-rev1
      - image-rev3
      - image-rev2
      - image
    - templates_images.yaml
    - templates_no_rset.yaml
    - image_simple
      - image
    - templates_bad_rset.yaml
    - resources.yaml
    - templates_bad_name.yaml
    - templates_syntax.yaml
    - templates_herit.yaml
    - templates_bad_herit.yaml
  - test_ethnetwork.py
  - test_templates.py
  - test_image
    - repos_bad.yaml
    - repos2.yaml
    - repos1.yaml
  - test_ethnetwork
    - resources.yaml
    - templates.yaml
    - networks_l3.yaml
  - conftest.py
- pylintrc
- .gitignore
- docs
  - Makefile
  - source
    - deps
      - openvswitch.rst
      - grpc.rst
      - slurm-spank.rst
      - etcd-production.rst
      - python-etcd.rst
    - install.rst
    - conf.rst
    - manpages
      - man5
        templates.yaml.rst
        networks.yaml.rst
        repos.yaml.rst
        batch.yaml.rst
        resources.yaml.rst
      - man7
        newvm-tutorial.rst
        9pmount-tutorial.rst
        cloudconfig-tutorial.rst
      - man1
        save.rst
        ssh.rst
        pcocc.rst
        exec.rst
        batch.rst
        alloc.rst
        dump.rst
        reset.rst
        scp.rst
        ckpt.rst
        image.rst
        display.rst
        template.rst
        console.rst
        ps.rst
        monitor-cmd.rst
        nc.rst
    - cli.rst
    - tutorials.rst
    - index.rst
    - conf.py
    - description.rst
  - build
    - man
      - pcocc-ckpt.1
      - pcocc-scp.1
      - pcocc-alloc.1
      - pcocc-cloudconfig-tutorial.7
      - pcocc-image.1
      - pcocc-repos.yaml.5
      - pcocc-nc.1
      - pcocc-batch.yaml.5
      - pcocc-batch.1
      - pcocc-reset.1
      - pcocc-console.1
      - pcocc-networks.yaml.5
      - pcocc-newvm-tutorial.7
      - pcocc-save.1
      - pcocc-exec.1
      - pcocc-display.1
      - pcocc-dump.1
      - pcocc.1
      - pcocc-resources.yaml.5
      - pcocc-template.1
      - pcocc-9pmount-tutorial.7
      - pcocc-templates.yaml.5
      - pcocc-ps.1
      - pcocc-ssh.1
      - pcocc-monitor-cmd.1
- MANIFEST.in
- confs
  - resources.yaml
  - repos.yaml
  - networks.yaml
  - templates.yaml
  - batch.yaml
- tox.ini

pcocc

pcocc (pronounced like "peacock") stands for Private Cloud On a Compute Cluster. It allows users of an HPC cluster to host their own clusters of VMs on compute nodes, alongside regular jobs. Users are thus able to fully customize their software environments for development, testing, or facilitating application deployment. Compute nodes remain managed by the batch scheduler as usual since the clusters of VMs are seen as regular jobs. For each virtual cluster, pcocc allocates the necessary resources to host the VMs, including private Ethernet and/or Infiniband networks, creates temporary disk images from the selected templates and instantiates the requested VMs.

Requirements and dependencies

pcocc makes use of several external components or services among which:

A Slurm cluster with the Lua SPANK plugin
Open vSwitch
An etcd database and the etcd python bindings
Qemu and KVM

Documentation

https://pcocc.readthedocs.io/en/latest/

Website

Find the latest source at:

https://github.com/cea-hpc/pcocc