A test suite for an Agreement Document Analyser (v 1.0) : Technical Report ISA–12–TR–03

The automated analysis operations of WS–Agreement documents proposed in recent works [1, 2, 3, 4] uses complex techniques of constraint programming as well as auxiliary code for agreement documents handling (XML documents mappings to constraint satisfaction problems (CSP), predicates parsings to CSP, etc). Implementing such document handling and CSP–based analysis operations is a time-consuming and complex task that easily leads to defects in detection and explanation solutions. In this context, we need specific testing mechanisms to increase our confidence in the quality and reliability of our developed tool. In this technical report, we present a test suite for an Agreement Document Analyser (ADA) framework. For the test suite design several popular techniques from the software testing community were used to develop a set of implementation–independent test cases to validate the functionality of the eight most significant ADA analysis operations. Specifically, we used three black-box testing techniques to design our test cases, namely: equivalence partitioning, pairwise testing, and error guessing. The suite is composed of 1074 test cases. Each test case is designed in terms of the inputs (an agreement offer, a template, or both) and expected outputs of the ADA analysis operations under test.