Continuous Validation - How is it done? - Part 1: Infrastructure

What do you need to implement a true continuous validation platform for a Cloud App?  This series of blog posts will answer this question.  This blog post is Part 1 in the series and covers the infrastructure required to implement this platform.

The above diagram illustrates the key elements of a Continuous Validation Infrastructure for a Cloud App. 

  1. CORE: ALM (Application Lifecycle Management) Server
    1. Requirements Management
    2. Specification Management
    3. Risk Management
    4. Traceability
    5. Test Case Management
    6. Test Campaign Management
    7. Reporting
    8. Part 11 Compliant
  2. ALM Server Controls the Test Automation Server where test automation scripts are deployed.  ALM Server manages the test schedules and configuration.  It determines the test environment also.  For example:  The OS and Browser Type that are required in the client VM that will be used to run the test automation scripts.
  3. Based on the OS and Browser type, the test automation server automatically instantiates a Test VM which is used to validate the SUT (System Under Test - the Cloud App).
  4. All test results are passed back to the ALM Server.
  5. Test Automation Logs and Cloud App Logs are fed into a Big Data Log Analysis App.  Detailed log analysis is performed on an ongoing basis to ensure compliance, review trends, etc..
  6. The ALM Server provides the single source of truth for the Cloud App Validation - GxP Compliant Summary Reports are available for every release of the Cloud App.