[🐛 Bug]: Tests using describe.skip are marked as failed in Browserstack about webdriverio

[wdio-bot]

Thanks for reporting!

We greatly appreciate any contributions that help resolve the bug. While we understand that active contributors have their own priorities, we kindly request your assistance if you rely on this bug being fixed. We encourage you to take a look at our contribution guidelines or join our friendly Discord development server, where you can ask any questions you may have. Thank you for your support, and cheers!

[jemishgopani]

@alexradulescuqa can you please attach reproducible example here?

[alexradulescuqa]

Hey @jemishgopani . Sure. I will do it in a few days. I'm a little caught up with work at the moment.

[alexradulescuqa]

I looked into it some more. If I am not mistaken, this is happening due to how Mocha does things.
However, Browserstack marks the tests as failed instead of pending.
Mocha docs say that they should be pending. 🤔

Also, according to documentation:

Note: Code in skipped suites, that is placed outside of hooks or tests is still executed, as mocha will still invoke the suite function to build up the suite structure for visualization.

This basically means that we'll always spin up the device in Browserstack even though the tests are marked as skipped, when using Mocha, instead of not starting the test at all.

https://mochajs.org/#inclusive-tests

I think that this is an expected behavior rather than a bug as a whole. Perhaps an improvement Browserstack can make, but not an issue on WebDriver.io's side.

Closing because of reasons above.