QuickSAT/Test (QS_TEST), a Framework for Automated Testing, and Support for Validation and Verification With Artifact Tracking for Autonomous and Complex Systems

QuickSAT/Test, QS_TEST, is an automated test framework that integrates a range of tools and applications to support a range of test and Verification and Validation environments, automatically generating and tracking artifacts for complex systems including integrated fault management systems, and human-rated and autonomous systems. QS_TEST, is designed to track artifacts during automated and/or manual testing and saving the results to its internal MySQL database and to a range of commercial products including Jira, JAMA, and other commercial products. The QS_TEST architecture is designed to also interface with a range of Hardware and Software “in the loop” environments allowing for “test for credit”. Due to the complex relationship of requirements for autonomous systems, QS_TEST can support Combinatorial Test Design, a technique that helps define test data ensuring near 100% test coverage based on the several combinations of test data inputs for a test suite. Due to the nature of autonomous systems, complex requirements can interact with each other. Combinatorial testing is an effective means to detect interactions faults caused by a combination of parameters. QS_TEST is designed exercise the combinatorial test cases and save the resulting artifacts. QS_TEST is a framework, written in Python that is part of QuickSAT/Designer, an environment developed with support from the Air Force Research Labs and NASA Ames Research Center, that utilizes model-based design processes, techniques and methodologies to develop conceptual designs that expediently leverages the best new commercially available and open source tools. The core open-source QS_TEST framework is currently in use by our customers at NASA JSC on the Lunar Gateway Program and by our DoD and commercial customers. QS_TEST supports ISO 9001, NASA STD-8739.8b, and DO-178C. For this research presentation we will discuss work done on QS_TEST, present the architecture and environment, and opportunities for universities, colleges, and small businesses to participate in the open-source elements of the project.