short test summary and -vv #12713
Description
a detailed description of the bug or problem you are having
(I've done my best to try and see if this is a duplicate and I'm sorry if it is, but it seems it's not)
Following #11777 (8.2.0) | changelog:
Text is no longer truncated in the short test summary info section when -vv is given.
The short summary can become completely impractical with -vv because each failure message could be hundreds of lines long.
It seems to be a strange choice given #11777 is about the text being truncated in:
E assert 50 == 49 E + where 50 = len({0: 0, 1: 1, 2: 2, 3: 3, ...}) and I don't see the original poster complaining about the short summary, but both were changed?
Was it the intended change ? Is there something we can do to keep the original -vv behaviour for the test output, and keep the "short test summary" short ? It's actually quite useful in CI that the last thing printed is the list of tests that failed and not why each of them failed: it's a summary and the full output is available above anyway.
I think the decision a lot of versions ago to add an excerpt of the failure reason to the short summary was a good compromise: it used otherwise unused space to add more useful info. But if that excerpt start taking more screen real estate space (potentially 100x more) than the summary itself, I'm not sure I understand why we would want that?
Maybe we could introduce a different "letter" (or a different option or something) to -r to get the list of tests without any kind of explanation of why they failed? Maybe the fix for #11777 should have affected the "failure explanation" and not the short summary?
output of pip list from the virtual environment you are using
$ pip list pip list Package Version --------- ------- iniconfig 2.0.0 packaging 24.1 pip 24.0 pluggy 1.5.0 pytest 8.3.2pytest and operating system versions
pytest==8.3.2
Ubuntu 22.04.4 LTS
minimal example if possible
def test_foo(): assert "a\n" * 50 == ""$ pytest -vv ============================================================== test session starts =============================================================== platform linux -- Python 3.12.4, pytest-8.3.2, pluggy-1.5.0 -- /home/joachim/other-src/pytest-verbose/.venv/bin/python3.12 cachedir: .pytest_cache rootdir: /home/joachim/other-src/pytest-verbose collected 1 item test_verbose.py::test_foo FAILED [100%] ==================================================================== FAILURES ==================================================================== ____________________________________________________________________ test_foo ____________________________________________________________________ def test_foo(): > assert "a\n" * 50 == "" E AssertionError: assert 'a\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\n' == '' E E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a E + a test_verbose.py:2: AssertionError ============================================================ short test summary info ============================================================= FAILED test_verbose.py::test_foo - AssertionError: assert 'a\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\na\n' == '' + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a + a =============================================================== 1 failed in 0.01s ================================================================