VisiRule AutoAudit
Automated Testing Harness
VisiRule AutoAudit provides both a fully automated and semi-automated testing harness so that you can easily validate the logic in your charts. Checking and verifying results using manual inspection and also regression testing is an essential part of gaining trust and confidence in the automation of sensitive and complex processes. It also serves as an essential role in verification and validation of the process of automation.
Simple Mode
Single Click Generate and Test
In its simplest mode, you can, with a single click, have VisiRule AutoAudit generate and execute a file of random test data one case at a time. Each test case is stored in a row in Excel and the execution mechanism executes the test file one row at a time. Upon completion, VisiRule AutoAudit creates a file of results that you can view in, say, Excel, and an associated output log which shows how each answer was reached and records any output generated. It also produces a summary which indicates what %age of the file succeeded to produce an end result, as it is possible for cases to 'fail' due to a gap in your logic.
Advanced Mode
Semi-automated testing and validation
In the more advanced mode, you can also supply your own test data, compose and execute different test data files, customize the content of the output logs, and most importantly, compare the results of different versions of your charts, to see what effect, if any, your edits have had.
Preparing the Data
You can edit the data, in say Excel, to focus on specific ranges and combinations of values that are of concern. You can build up a test suite of known problem cases to use whenever the knowledge contained in the chart is revisited.
Executing the Data
You can select which test data file to use by name. You can execute a chart against different sets of test data which maybe cover different aspects of concern. You can use the same data with two different versions or iterations of a chart.
Comparing Results
You can nominate any two sets of results to compare for any divergence.
Spotting the Difference
AutoAudit will compare the results between the two separate runs using the same test data and report on any cases which diverge. This means that you can check to see if any of the changes you have made to the chart have had any unintended consequences.
