PyTest "XPASS" is incorrectly treated as a failure regardless of strict setting. about teamcity-messages

[shalupov]

Unfortunately TeamCity has only three test states: passed/failed/ignored. How do you want to present XPASS result without strict mark?

[netanelrevah]

Hi, I'm getting the same problem on IntelliJ test runner.

I tried to extract py.test results to JUnit XML, and there the test going to skipped category:

the test:

import pytest

@pytest.mark.xfail()
def test_a():
    assert True

the result:

<?xml version="1.0" encoding="utf-8"?>
<testsuite errors="0" failures="0" name="pytest" skips="1" tests="0" time="0.015">
  <testcase classname="test_a" name="test_a" time="0.000144958496094">
    <skipped message="xfail-marked test passes unexpectedly"/>
  </testcase>
</testsuite>

So i think ignored is good category.