jdlrobson / barry-the-browser-test-bot Goto Github PK

Erik suggested using:

project:mediawiki/extensions/CirrusSearch (label:Verified>=0) status:open label:Code-Review=0,user=ebernhardson NOT age:2w

query should be an option from the command line.
This may be a better default.

To easily identify which patch a paste is referring to, it would be great to add a link back to the patch.

If the browser bot starts running a test and a new patchset is uploaded before the test finishes, the bot attaches its review to the top patch set, rather than the one it reviewed.

Currently we can only specify a set of tags to include, i think should also be able to list the tags to exclude. Excludes passed to cucumber are done as '~@expected_failures'. The easiest way to implement this would be to not handle the @ in the code, but just expect the command line to include the appropriate @ or ~@ symbol.

I get this when I forgot to arc install-certificate

Traceback (most recent call last):
File "./barrybot.py", line 225, in
args.verbose
File "./barrybot.py", line 195, in watch
output = get_paste_url(output)
File "./barrybot.py", line 173, in get_paste_url
return output.split(': ')[1].strip()

Cirrussearch uses an external service (elasticsearch) that needs to be fully reset to guarantee one test run failing doesn't leave things in an odd state that breaks future test runs. Basically just need to be able to point to a command to be executed before the tests are run.