defects,randomconfiguration is supported by implementation, but it is not allowed by the XML configuration file schema #6254
Description
| Q | A |
|---|---|
| PHPUnit version | 11.5.24 |
| PHP version | 8.3.22 |
| Installation Method | Composer / PHAR |
Summary
a execution order of "defects,random" seems to be a useful choice, as it combines a very fast feedback loop when re-running previously failed tests while it also allows random test order to harden tests against ordering problems
Current behavior
using a phpunit.xml like
<?xml version="1.0" encoding="UTF-8"?> <phpunit xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="./vendor/phpunit/phpunit/phpunit.xsd" bootstrap="./vendor/autoload.php" colors="true" executionOrder="defects,random" failOnWarning="true" failOnRisky="true" requireCoverageMetadata="true" displayDetailsOnPhpunitDeprecations="true" displayDetailsOnTestsThatTriggerDeprecations="true" displayDetailsOnTestsThatTriggerWarnings="true" cacheDirectory="./build/cache/phpunit" > works like expected, but xml validation fails, since defects,random is not a valid combiation per XSD:
see
Lines 117 to 138 in 6c7855f
PHPStorm screenshot:
How to reproduce
change phpunit.xml to
executionOrder="defects,random"
Expected behavior
it should be a valid option to use "defects,random"