Heimdall is a Test Reporting Tool which is primarily built to publish your test execution results to the google sheet and notify the result on Communication channels (like Slack)
Earlier heimdall was providing limited number of static tags to be passed for test execution(sanity,smoke,regression,suite). Going forward user would be able to pass custom tag and can run test-cases having that tag.
Currently, the user is unable to input the S3 bucket name from which to pick the test execution results. User won't be able to update the sheet with test results as, by default, the S3 call will be made to miq test bucket via addon script.
Allowing user to input S3 bucket name would help to update the sheet with test execution results.
Currently user is allowed to select only one test-type (for example:either regression / sanity) for execution. Going forward user should be able to select multiple test-types for execution. Attaching the screenshot which depicts how the current selection is.
We have an option to input S3 Bucket Name in the google sheet configurations. If the entered bucket name doesn't match with the existing bucket name we might lose the data, so basic validations should be there to check the S3 bucket details. This can be done using S3 Access keys and Secret keys, an alert message could be shown to the user before saving the configuration details, this ensures the proper validation of data entered in the configuration.
Currently, we fetch the test description from the cucumber generated report instead of Jira during slack notification.
Current limitation :
Test summary/description on slack notification and Heimdall sheet might be different as they are being picked from two different sources
Enhancement :
Fetching test summary/description from JIRA would help in maintaining uniformity between slack notification and Heimdall content
Currently, we only support Slack notifications. Adding an email notification as an option will help the community to still use Heimdall when they don't support Slack.