Project: nmos-testing (GitHub Link)

nmos-testing-master
- nmos-test.py
- LICENSE
- nmostesting
  - IS05Utils.py
  - TestHelper.py
  - TestResult.py
  - IS04Utils.py
  - CRL.py
  - Patches.py
  - suites
    - IS0701Test.py
    - IS0601Test.py
    - IS0403Test.py
    - IS0401Test.py
    - IS0902Test.py
    - IS0402Test.py
    - IS1001Test.py
    - BCP00301Test.py
    - __init__.py
    - IS0501Test.py
    - is08
      - outputs.py
      - activation.py
      - action.py
      - testConfig.py
      - inputs.py
      - io.py
      - helperTools.py
      - __init__.py
      - calls.py
      - active.py
    - IS0502Test.py
    - IS0802Test.py
    - IS0801Test.py
    - IS0702Test.py
    - IS0901Test.py
  - templates
    - result.html
    - index.html
  - MdnsListener.py
  - NMOSUtils.py
  - Config.py
  - GenericTest.py
  - NMOSTesting.py
  - IS07Utils.py
  - OCSP.py
  - __init__.py
  - DNS.py
  - mocks
    - Node.py
    - __init__.py
    - Registry.py
    - System.py
  - static
    - js
      - script.js
      - bootstrap.min.js
      - bootstrap.js.map
      - bootstrap.bundle.min.js
      - result_script.js
      - bootstrap.js
      - bootstrap.bundle.js
      - bootstrap.min.js.map
    - css
      - bootstrap-reboot.css
      - bootstrap-grid.min.css.map
      - bootstrap-reboot.css.map
      - bootstrap-grid.css.map
      - style.css
      - bootstrap.min.css
      - bootstrap.css
      - bootstrap-reboot.min.css
      - bootstrap-reboot.min.css.map
      - bootstrap-grid.css
      - bootstrap-grid.min.css
  - Specification.py
- .flake8
- test_data
  - IS0402
    - v1.3_flow.json
    - v1.3_node.json
    - v1.3_device.json
    - v1.3_sender.json
    - v1.3_source.json
    - subscriptions_request.json
    - v1.3_receiver.json
  - IS0401
    - video.sdp
    - dns_records.zone
    - data.sdp
    - audio.sdp
    - mux.sdp
  - IS0902
    - dns_records.zone
  - core
    - error.json
    - dns_base.zone
  - BCP00301
    - ca
      - generateCerts
      - intermediate
        index.txt.old
        openssl.cnf
        csr
        intermediate.csr.pem
        ecdsa.api.testsuite.nmos.tv.csr.pem
        rsa.mocks.testsuite.nmos.tv.csr.pem
        rsa.api.testsuite.nmos.tv.csr.pem
        ocsp.testsuite.nmos.tv.csr.pem
        ecdsa.mocks.testsuite.nmos.tv.csr.pem
        index.txt
        index.txt.attr
        crl
        intermediate.crl.pem
        certs
        ecdsa.mocks.testsuite.nmos.tv.cert.pem
        rsa.api.testsuite.nmos.tv.cert.pem
        ecdsa.api.testsuite.nmos.tv.cert.chain.pfx
        rsa.api.testsuite.nmos.tv.cert.chain.pem
        ocsp.testsuite.nmos.tv.cert.pem
        rsa.mocks.testsuite.nmos.tv.cert.pem
        ecdsa.api.testsuite.nmos.tv.cert.chain.pem
        rsa.api.testsuite.nmos.tv.cert.chain.pfx
        intermediate.cert.pem
        ecdsa.mocks.testsuite.nmos.tv.cert.chain.pfx
        rsa.mocks.testsuite.nmos.tv.cert.chain.pfx
        ca-chain.cert.pem
        ecdsa.api.testsuite.nmos.tv.cert.pem
        ecdsa.mocks.testsuite.nmos.tv.cert.chain.pem
        rsa.mocks.testsuite.nmos.tv.cert.chain.pem
        private
        ocsp.testsuite.nmos.tv.key.pem
        dhparam.pem
        ecdsa.api.testsuite.nmos.tv.key.pem
        rsa.mocks.testsuite.nmos.tv.key.pem
        ecdsa.mocks.testsuite.nmos.tv.key.pem
        intermediate.key.pem
        rsa.api.testsuite.nmos.tv.key.pem
        crlnumber.old
        newcerts
        1004.pem
        1006.pem
        1008.pem
        1002.pem
        1005.pem
        1000.pem
        1007.pem
        1003.pem
        1001.pem
        serial
        serial.old
        index.txt.attr.old
        crlnumber
      - index.txt.old
      - openssl.cnf
      - index.txt
      - index.txt.attr
      - generateCA
      - generateDHParams
      - certs
        ca.cert.pem
      - private
        ca.key.pem
      - generateDefaultCerts
      - openssl.cnf.intermediate
      - newcerts
        1000.pem
      - serial
      - serial.old
    - README.md
  - IS0502
    - video.sdp
    - data.sdp
    - audio.sdp
    - mux.sdp
  - IS1001
    - authorization_request_data.json
    - register_client_request_data.json
- setup.py
- .travis.yml
- README.md
- config.ini
- requirements.txt
- Dockerfile
- testssl
  - README.md
- NOTICE
- .gitignore
- docs
  - 4.0. Known Issues.md
  - 5.2. Extension - Testing A New Specification.md
  - 3.0. Testing Profiles.md
  - 5.0. Extension.md
  - images
  - 6.0. Advanced Testing.md
  - 2.0. Usage.md
  - 5.1. Extension - Adding New Tests.md
  - 2.2. Usage - Testing BCP-003-01 TLS.md
  - 1.2. Installation - Docker.md
  - 1.1. Installation - Local.md
  - 2.6. Usage - Using the API.md
  - 6.1. Advanced Testing - IS-04 Node API.md
  - 2.3. Usage - Testing IS-10 Authorization.md
  - 1.0. Installation.md
  - 2.5. Usage - Non-Interactive Mode.md
  - 2.1. Usage - Testing Unicast Discovery.md
  - 3.1. Testing Profiles - JT-NM TR-1001.md
  - 2.4. Usage - Testing of SDP Files.md
- utilities
  - run-test-suites
    - example-config-command.txt
    - runTestSuites.py
    - gsheetsImport
      - README.md
      - requirements.txt
      - resultsImporter.py
      - bulk-import.sh
    - README.md
    - requirements.txt
    - .gitignore
  - deploy
    - docker_hub
    - docker-compose.yml
  - README.md
  - is-05-control
    - sender-to-20-1080i-7.json
    - video-1080i-7.sdp
    - is05Control.py
    - tune-receiver-to-reference.json
    - README.md
    - requirements.txt
    - dummy-sdp.sdp
  - uuid-checker
    - uuidChecker.py
    - README.md
    - requirements.txt
  - mdns-monitor
    - mdnsMonitor.py
    - README.md
    - requirements.txt
  - dut-data-exporter
    - dutDataExporter.py
    - README.md
    - requirements.txt

NMOS API Testing Tool

This tool creates a simple web service which tests implementations of the NMOS APIs.

The following test suites are currently supported:

IS-04 Node API
IS-04 Registry APIs
IS-04 Node API (Peer to Peer)
IS-05 Connection Management API
IS-05 Interaction with IS-04
IS-06 Network Control API
IS-07 Event & Tally API
IS-07 Interaction with IS-04 and IS-05
IS-08 Channel Mapping API
IS-08 Interaction with IS-04
IS-09 System API
IS-09 System API Discovery
IS-10 Authorization API
BCP-002-01 Natural Grouping (see IS-04 Node API)
BCP-003-01 Secure API Communications
BCP-003-02 Authorization (see IS-10 Authorization API)

When testing any of the above APIs it is important that they contain representative data. The test results will generate 'Could Not Test' results if no testable entities can be located. In addition, if devices support many modes of operation (including multiple video/audio formats) it is strongly recommended to re-test them in multiple modes.

Installation & Usage

Detailed instructions can be found in the documentation

Important Notes

The IS-04 Node and IS-09 Discovery tests create mock mDNS announcements on the network unless the nmostesting/Config.py ENABLE_DNS_SD parameter is set to False, or the DNS_SD_MODE parameter is set to 'unicast'. It is critical that these tests are only run in isolated network segments away from production Nodes and registries. Only one Node can be tested at a single time. If ENABLE_DNS_SD is set to False, make sure to update the Query API hostname/IP and port via QUERY_API_HOST and QUERY_API_PORT in the nmostesting/Config.py.
For IS-04 Registry tests of Query API pagination, make sure the time of the test device and the time of the device hosting the tests is synchronized.
For IS-05 tests #29 and #30, and IS-08 test #4 (absolute activation), make sure the time of the test device and the time of the device hosting the tests is synchronized.