Project: kryptoflow (GitHub Link)

kryptoflow-master
- Dockerfile.tfserving
- .coveragerc
- keras_training.ipynb
- setup.py
- setup.cfg
- .travis.yml
- README.md
- tests
  - test_sklearn_model_io.py
  - sample_schemas
    - keyschema.avsc
    - twitter.avsc
    - reddit.avsc
    - gdax.avsc
  - test_model_serving.py
  - test_setup_streamer.py
  - test-project
    - kafka
      - count_messages.sh
      - set_topics_config.sh
      - server.properties
    - docker-compose.yaml
    - Dockerfile.tfserving
    - serialized
      - .gitkeep
    - model.py
    - kryptoflow.yaml
    - __init__.py
    - supervisor
      - .gitkeep
      - supervisord.conf
    - kryptoflow
      - reddit.py
      - gdax.py
      - twitter.py
    - Dockerfile
    - .gitignore
    - secrets.yaml
  - __init__.py
  - test_managers
    - test_secrets_manager.py
    - test_resource_manager.py
    - test_init_project.py
    - __init__.py
    - test_data_manager.py
    - test_config_manager.py
  - test_keras_model_io.py
  - conftest.py
- kryptoflow
  - ml
    - labeling.py
    - model.py
    - __init__.py
    - dataset.py
  - managers
    - data.py
    - project.py
    - app_config.py
    - constants.py
    - __init__.py
    - resource.py
    - secrets.py
    - dashboard.py
    - base.py
  - api
    - tensorflow_serving
      - apis
        prediction_service_pb2.py
        input_pb2.py
        predict_pb2.py
        get_model_metadata_pb2.py
        inference_pb2.py
        regression_pb2.py
        predict_pb2_grpc.py
        model_pb2.py
        inference_pb2_grpc.py
        prediction_service_pb2_grpc.py
        input_pb2_grpc.py
        get_model_metadata_pb2_grpc.py
        regression_pb2_grpc.py
        model_pb2_grpc.py
        classification_pb2.py
        classification_pb2_grpc.py
      - __init__.py
    - dist
      - index.html
      - static
        js
        0.3206c8eb242cfaf25d6a.js.map
        manifest.7f214124d3db6e87f15d.js.map
        app.fb4f656bf5d0b2ec2f00.js
        app.fb4f656bf5d0b2ec2f00.js.map
        manifest.7f214124d3db6e87f15d.js
        1.1c8f40220698a3d9114b.js
        1.1c8f40220698a3d9114b.js.map
        0.3206c8eb242cfaf25d6a.js
        css
        app.b3939b4a0c97ff13b0df16da0d58510d.css
        app.b3939b4a0c97ff13b0df16da0d58510d.css.map
    - helpers
      - __init__.py
      - tf_serving_client.py
    - __init__.py
    - endpoints
      - ws.py
      - predict.py
      - live.py
      - historic.py
      - __init__.py
    - utils.py
    - test.py
  - cli
    - init.py
    - scrape.py
    - serve.py
    - version.py
    - train.py
    - __init__.py
    - dashboard.py
  - models
    - model.py
    - __init__.py
    - conf.py
  - common
    - data_interface.py
    - observers.py
    - supervisor_client.py
    - validation.py
    - __init__.py
    - utils.py
  - scrapers
    - reddit.py
    - gdax_ws.py
    - twitter.py
    - __init__.py
    - transforms
      - sent_analysis.py
      - __init__.py
  - template
    - kafka
      - count_messages.sh
      - set_topics_config.sh
      - backups
        .gitkeep
      - server.properties
      - logs
        .gitkeep
      - schemas
        keyschema.avsc
        twitter.avsc
        reddit.avsc
        gdax.avsc
    - docker-compose.yaml
    - Dockerfile.tfserving
    - serialized
      - .gitkeep
    - model.py
    - kryptoflow.yaml
    - __init__.py
    - supervisor
      - .gitkeep
      - supervisord.conf
    - kryptoflow
      - reddit.py
      - gdax.py
      - twitter.py
    - Dockerfile
    - .gitignore
    - secrets.yaml
  - trading
    - __init__.py
    - agent.py
  - __init__.py
  - main.py
  - ws
    - client.py
    - __init__.py
- Dockerfile
- couscous.yml
- .gitignore
- docs
  - quickstart.md
  - config.md
  - license.md
  - index.md
  - architecture.md
  - installation.md
  - authors.md
  - changes.md
- LICENSE.txt
- requirements
  - default.txt
  - extras
    - nlp.txt
    - test.txt
    - tf_gpu.txt
    - aws.txt
    - tf.txt
- MANIFEST.in
- docker-compose.yml

Kryptoflow

Algorithmic crypto trading framework with Kafka and TensorFlow (Keras + TensorFlow Serving)

Documentation live at: https://carlomazzaferro.github.io/kryptoflow/index.html

STATUS: pre-alpha. Very active development. Feel free to rip the code apart, repurpose it, improve on it, or do whatever else it may please. Documentation is also not fully up to date. This will change soon.

Description

The idea behind this project is to take care of the infrastructural work that goes behind building a machine learning-driven trading systems. In particular, the aim is giving users a working set up for:

Gathering as granular data as possible
Test a variety of strategies intuitively and with low friction
Deploying models easily and keeping them up to date
Trading continuously and reliably

All this done through a rich API and a browser-based GUI. Want to test your newly developed deep learning model tplace to start.

Another use case: want to build something like Quantopian but using cutting-edge machine learning? Then you may need to build it yourself. Here you'll find most of the tooling needed.

`` Installation and Requirements

Some basic requirements:

python3.6
Docker

More at: https://carlomazzaferro.github.io/kryptoflow/installation.html

$ pip install kryptoflow

Creating a New Project

$ kryptoflow init --name make-money --path /home/user/projects

This will create all the configuration necessary to get going, alongside docker files and other stuff. Cd into the repo and check out its contents.

Spinning Up Resources

From the project directory, run:

docker-compose up

Training and Deploying a Model

$ kryptoflow train --epocs 10 --model model.py

Then

$ kryptoflow serve --model-number 1

License

GNU General Public License v3.0