Test Case Verification Status Distribution
Use this metric to count the number of tests that do not have pass/fail criteria and the number of tests that do have pass/fail criteria.
A test has pass/fail criteria if it has at least one of the following:
at least one executed verify statement
at least one executed temporal or logical assessment
custom criteria that has a pass/fail status in Simulink Test Manager
baseline criteria which determine the pass/fail criteria of the test
This metric returns the result as a distribution of the results of the
Includes only tests in the project that test the model or subsystems in the unit for which you collect metric data.
Does not count the pass/fail criteria of tests that run in software-in-the-loop (SIL) or processor-in-the-loop (PIL) mode. The metric shows these tests as Missing Pass/Fail Criteria.
To collect data for this metric:
In the Model Testing Dashboard, in the Model Test Status section, place your cursor over the Inconclusive widget.
getMetricswith the metric ID
Collecting data for this metric loads the model file and test files and requires a Simulink® Test™ license.
For this metric, instances of
Value as a distribution
structure that contains these fields:
BinCounts— The number of tests in each bin, returned as an integer vector.
BinEdges— The outputs of the
TestCaseVerificationStatusmetric, returned as an integer vector. The integer outputs represent the three test verification statuses:
0— The test is missing pass/fail criteria.
1— The test has pass/fail criteria.
2— The test was not run.
The default compliance thresholds for this metric are:
0unit tests are missing pass/fail criteria
1or more unit tests do not have pass/fail criteria