Tests Failing when using torture .We tried on our self hosted server and then tried on jitsi meet (https://meet.jit.si/) and getting the same errors as below about jitsi-meet-torture

[bgrozev]

It is expected for TCPTest to fail against meet.jit.si as we don't have ice/tcp enabled (we have turn/tls instead).

…

On Sun, Nov 28, 2021, 10:50 AM Дамян Минков ***@***.***> wrote: The one muteAfterJoinCanShareAndUnmute is known to fail sometimes and we will be working on fixing it in the following weeks or we will disable it, as for the TCPTest ... not sure we run it anymore ... maybe something with it is not working it needs debugging the client ... — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#387 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAY5BOZITL4KNH6OXCJAZIDUOJMU5ANCNFSM454ZKZZQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[dkgrieshammer]

Same here; any updates?

[damencho]

How are you running the test?

[dkgrieshammer]

How are you running the test?

@damencho I just cloned the repo & run MuteTest & TCPTest, fails against own install as well as on meet.jit.si;
mvn test -Djitsi-meet.instance.url="https://meet.jit.si" -Djitsi-meet.tests.toRun="MuteTest,TCPTest"

I did that to narrow down the errors I got using the docker-hub version on local macbook as well as on an AWS Debian;
any hints would be highly appreciated 🙏

Error Log:

[1] End tcpTest.
[1] Closing web.participant1
[1] Closing web.participant2
[ERROR] Tests run: 415, Failures: 2, Errors: 0, Skipped: 406, Time elapsed: 88.967 s <<< FAILURE! - in TestSuite
[ERROR] muteAfterJoinCanShareAndUnmute(org.jitsi.meet.test.MuteTest)  Time elapsed: 25.645 s  <<< FAILURE!
org.openqa.selenium.TimeoutException:
Expected condition failed: waiting for org.jitsi.meet.test.util.TestUtils$$Lambda$344/0x0000000800e89390@7dd611c8 (tried for 10 second(s) with 500 milliseconds interval)
Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:17:03'
System info: host: 'David-Air.local', ip: '**IP**', os.name: 'Mac OS X', os.arch: 'aarch64', os.version: '12.0.1', java.version: '17.0.1'
Driver info: org.openqa.selenium.chrome.ChromeDriver
Capabilities {acceptInsecureCerts: false, browserName: chrome, browserVersion: 96.0.4664.55, chrome: {chromedriverVersion: 96.0.4664.45 (76e4c1bb2ab46..., userDataDir: /var/folders/6g/4hb15fqd6x7...}, goog:chromeOptions: {debuggerAddress: localhost:54971}, javascriptEnabled: true, networkConnectionEnabled: false, pageLoadStrategy: normal, platform: MAC, platformName: MAC, proxy: Proxy(), setWindowRect: true, strictFileInteractability: false, timeouts: {implicit: 0, pageLoad: 300000, script: 30000}, unhandledPromptBehavior: dismiss and notify, webauthn:extension:credBlob: true, webauthn:extension:largeBlob: true, webauthn:virtualAuthenticators: true}
Session ID: b1cc9df88ce281bcdce8f04a90ea983a
	at org.jitsi.meet.test.MuteTest.muteParticipant1BeforeParticipant2JoinsAndScreenshare(MuteTest.java:281)
	at org.jitsi.meet.test.MuteTest.muteAfterJoinCanShareAndUnmute(MuteTest.java:231)

[ERROR] tcpTest(org.jitsi.meet.test.TCPTest)  Time elapsed: 17.649 s  <<< FAILURE!
org.openqa.selenium.TimeoutException:
Expected condition failed: waiting for WebParticipant[web.participant2]@424106351#isIceConnected (tried for 15 second(s) with 500 milliseconds interval)
Build info: version: '3.141.59', revision: 'e82be7d358', time: '2018-11-14T08:17:03'
System info: host: 'David-Air.local', ip: '**IP**', os.name: 'Mac OS X', os.arch: 'aarch64', os.version: '12.0.1', java.version: '17.0.1'
Driver info: org.openqa.selenium.chrome.ChromeDriver
Capabilities {acceptInsecureCerts: false, browserName: chrome, browserVersion: 96.0.4664.55, chrome: {chromedriverVersion: 96.0.4664.45 (76e4c1bb2ab46..., userDataDir: /var/folders/6g/4hb15fqd6x7...}, goog:chromeOptions: {debuggerAddress: localhost:55275}, javascriptEnabled: true, networkConnectionEnabled: false, pageLoadStrategy: normal, platform: MAC, platformName: MAC, proxy: Proxy(), setWindowRect: true, strictFileInteractability: false, timeouts: {implicit: 0, pageLoad: 300000, script: 30000}, unhandledPromptBehavior: dismiss and notify, webauthn:extension:credBlob: true, webauthn:extension:largeBlob: true, webauthn:virtualAuthenticators: true}
Session ID: 085c268efbdf155d25a6688815a7784f
	at org.jitsi.meet.test.TCPTest.tcpTest(TCPTest.java:82)

[INFO]
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR]   MuteTest.muteAfterJoinCanShareAndUnmute:231->muteParticipant1BeforeParticipant2JoinsAndScreenshare:281 » Timeout
[ERROR]   TCPTest.tcpTest:82->WebTestBase.ensureTwoParticipants:104->WebTestBase.ensureTwoParticipants:126->WebTestBase.ensureTwoParticipantsInternal:157 » Timeout
[INFO]
[ERROR] Tests run: 411, Failures: 2, Errors: 0, Skipped: 402
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:30 min
[INFO] Finished at: 2021-11-28T10:25:24Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.20:test (default-test) on project jitsi-meet-torture: There are test failures.

[damencho]

The one muteAfterJoinCanShareAndUnmute is known to fail sometimes and we will be working on fixing it in the following weeks or we will disable it, as for the TCPTest ... not sure we run it anymore ... maybe something with it is not working it needs debugging the client ...