shunfei/DCMonitor

Project: DCMonitor (GitHub Link)

DCMonitor-master
- src
  - main
    - resources
      - public
        zk.vm
        nav.html
        head.html
        druid.vm
        lib
        bootstrap
        bootstrap.min.js
        bootstrap.min.css
        semantic
        themes
        default
        assets
        images
        fonts
        icons.woff
        icons.otf
        icons.woff2
        icons.eot
        icons.ttf
        github
        assets
        fonts
        octicons-local.ttf
        octicons.woff
        octicons.ttf
        octicons.svg
        basic
        assets
        fonts
        icons.woff
        icons.svg
        icons.eot
        icons.ttf
        fonts
        ObQr5XYcoH0WBoUxiaYK3_Y6323mHUZFJMgTvxaG2iE.woff2
        1YwB1sO8YE1Lyjf12WNiUA.woff2
        YMOYVM-eg6Qs9YzV9OSqZfesZW2xOQ-xsNqO47m55DA.woff2
        H2DMvhDLycM56KNuAtbJYA.woff2
        PLygLKRVCQnA5fhu3qk5fQ.woff2
        AcvTq8Q0lyKKNxRlL28RnxJtnKITppOI_IvcXXDNrsc.woff2
        HkF_qI1x_noxlxhrhMQYEFtXRa8TVwTICgirnJhmVJw.woff2
        UyBMtLsHKBKXelqf4x7VRQ.woff2
        semantic.fonts.css
        jquery
        jquery.tablesorter.min.js
        jquery-1.11.0.min.js
        wdata
        lang
        en.js
        zh-tw.js
        zh-cn.js
        WdatePicker.js
        skin
        default
        img.gif
        datepicker.css
        whyGreen
        img.gif
        datepicker.css
        bg.jpg
        WdatePicker.css
        datePicker.gif
        calendar.js
        highcharts
        kafka.vm
        topic_consumer.vm
        js
        kafka_topic.js
        console.js
        druid_console.js
        kafka_console.js
        smartpaginator.js
        zk_console.js
        image
        css
        smartpaginator.css
        table-style.css
        style.css
        console.vm
      - middle_manager_msg
      - druid_metrics_msg
      - zk_stat_msg
    - java
      - com
        sf
        prometheus
        PrometheusQuery.java
        PrometheusQueryService.java
        log
        Logger.java
        notify
        NotifyService.java
        Notify.java
        monitor
        Resources.java
        kafka
        KafkaStats.java
        KafkaInfoFetcher.java
        StormKafkaInfos.java
        KafkaInfos.java
        utils
        DCMZkUtils.java
        Utils.java
        HttpRequest.java
        PrometheusUtils.java
        Pair.java
        JsonValues.java
        TagValue.java
        DCMonitor.java
        Event.java
        CommonFetcher.java
        zk
        ZookeeperStatParser.java
        ZookeeperInfoFetcher.java
        ZookeeperHosts.java
        druid
        DruidService.java
        EmitMetricsAnalyzer.java
        DruidInfos.java
        DruidInfoFetcher.java
        config
        VelocityConfiguration.java
        DateTimeConverter.java
        controllers
        IndexController.java
        KafkaController.java
        MetricsController.java
        ZookeeperController.java
        DruidController.java
        Config.java
        InfoFetcher.java
- img
- pom.xml
- LICENSE
- config
  - config.json
  - prometheus.yml
  - log4j.xml
  - application.properties
- run.sh
- README.md
- .gitignore
- build.sh

DCMonitor

A simple, lightweight Data Center monitor, currently includes Zookeeper, Kafka, Druid(in progress). Motivated by KafkaOffsetMonitor, but faster and more stable.

It is written in java, and use Prometheus as historical metrics storage.

License

The MIT License (MIT)

Zookeeper monitor

Kafka monitor

Druid monitor

Dependences

Run
- java(1.7 or later)
- Prometheus
Compile
- maven
- java(1.7 or later)

Installation

Set up your Zookeeper, Kafka, Druid(If you have) for monitoring.
Set up Prometheus/.
- Download a Prometheus release 0.16.0 from https://github.com/prometheus/prometheus/releases and set it up following http://prometheus.io/docs/introduction/getting_started/, you can stop before here if you don't want to go deep into prometheus. And don't worry, it is extremely easy.
- Add a job to scrape DCMonitor's metrics, job config should looks like:
```
  - job_name: 'dcmonitor'
    scrape_interval: 5s
    scrape_timeout: 10s
    target_groups:
      - targets: ['localhost:8075']
```
  Here localhost:8075 is the DCMonitor's host:port which web service listen on (configured in application.properties). The completed example is here.
  
  After that go to http://<hostname>:9090/status, expected to see the dcmonitor endpoints in targets section. It is in UNHEALTHY state because we havn't set up DCMonitor web service yet!
Compile & deploy DCMonitor
- Compile
```
git clone [email protected]:shunfei/DCMonitor.git
cd DCMonitor
./build.sh
```
  Then a target folder will be generated under root folder.
- Deploy
  
  You only need to deploy target, run.sh, config to target machine.
  
  Modify configurations in config/config.json and application.properties.
  
  Run run.sh, will start the DCMonitor web service. If every thing is fine, visit http://<hostname>:8075 to enjoy!