ImportError does not result in collection error about pytest-asyncio

[seifertm]

Thanks for the investigation. This seems to be connected to #713 .

The pytest-asyncio currently creates "dynamic" fixtures by adding them to the Python object, for example a module. Once the module is collected by pytest, the fixture is evaluated as usual. This approach is internally used by pytest as well and leaves the complicated fixture evaluation to pytest rather than having to reproduce in pytest-asyncio.

Unfortunately, pytest-asyncio currently adds those fixtures as part of the pytest_collectstart hook. When trying to add a fixture to a module, that module is imported and may raise errors like pytest._outcomes.Skip or pytest.CollectError. The pytest_collectstart hook isn't supposed to handle those kinds of exceptions, so pytest-asyncio tries to do it. That effort seems to be unsuccessful so far.

Given that fixing one bug leads to another bug, I think pytest-asyncio should look for an entirely different place to add the fixtures rather than in pytest_collectstart. There are chances that, in the future, pytest will provide a way to add fixtures to nodes, but until then pytest-asyncio needs to find a better workaround.

[seifertm]

@collielimabean This should be resolve with pytest-asyncio v0.23.3