feat: add junit output callback

[Minipada]

What I did

I added a callback to get JUNIT files as an output.

Why I did it

In CI context, Jenkins uses JUNIT files to record tests. I have based my work on the JSON factory example.

Test output call example

test.add_output_callbacks(junit.OutputToJUNIT( os.path.join(path, '%s_%s_%s.xml' % (test_name, dut, datetime.now().strftime('%Y-%m-%d-%H-%M'))), indent=2)) 

XML example

<?xml version="1.0" ?> <testsuites disabled="0" errors="0" failures="0" tests="6" time="14.463"> <testsuite disabled="0" errors="0" failures="0" name="test" skipped="0" tests="6" time="14.463"> <testcase classname="single_node_chain.io" name="trigger_phase" time="0.002000"/> <testcase classname="single_node_chain.io" name="test_digital_input" time="3.017000"> <system-out>name: input_4 validators: ['x == 0'] measured_value: 0 outcome: PASS log: Testing IO1 name: input_2 validators: ['x == 0'] measured_value: 0 outcome: PASS log: Testing IO2 name: input_3 validators: ['x == 1'] measured_value: 1 outcome: PASS log: Testing IO3 name: input_1 validators: ['x == 1'] measured_value: 1 outcome: PASS log: Testing IO4 </system-out> </testcase> <testcase classname="single_node_chain.io" name="test_analog_single_ended_input" time="2.864000"> <system-out>name: voltage_2 validators: ['1.44 &lt;= x &lt;= 1.7600000000000002'] measured_value: 1.6173095703125 outcome: PASS log: Testing IO1 voltage 2 name: voltage_0 validators: ['-0.05 &lt;= x &lt;= 0.05'] measured_value: 0.0018310546875 outcome: PASS log: Testing IO1 voltage 0 name: voltage_3 validators: ['2.25 &lt;= x &lt;= 2.75'] measured_value: 2.527099609375 outcome: PASS log: Testing IO1 voltage 3 name: voltage_5 validators: ['3.6899999999999995 &lt;= x &lt;= 4.51'] measured_value: 4.1453857421875 outcome: PASS log: Testing IO1 voltage 5 name: voltage_1 validators: ['0.72 &lt;= x &lt;= 0.8800000000000001'] measured_value: 0.80908203125 outcome: PASS log: Testing IO1 voltage 1 name: voltage_4 validators: ['2.9699999999999998 &lt;= x &lt;= 3.63'] measured_value: 3.33642578125 outcome: PASS log: Testing IO1 voltage 4 </system-out> </testcase> </testsuite> </testsuites> 

Test with Jenkins plugin Test results analyzer

Success

Failure

Note

I was not quite sure of what to put instead of test in line 66

return TestSuite.to_xml_string([TestSuite("test", self.test_cases)]) 

---

This change is 

[tcm0116]

I need this exact feature, so I second this pull request.

[Minipada]

You can take the file and add it to your project, that's what I did since it was never reviewed.

[tcm0116]

I was having an issue with this throwing an exception because there was no "validators" entry in the phase_data dictionary for a measurement generated by a monitor. The change below resolved that issue with me.

 if "name" in phase_data: output.extend(["name: " + phase_data["name"]]) if "validators" in phase_data: output.extend(["validators: " + str(phase_data["validators"])]) if "measured_value" in phase_data: output.extend(["measured_value: " + str(phase_data["measured_value"])]) if "outcome" in phase_data: output.extend(["outcome: " + phase_data["outcome"]]) output.extend(["log: " + "\n".join(log_output), "\n"])