Scenario outline values don't appear on the report about cucumber-reporting

[kingsleyh]

this looks like the bug with scenario outline in cucumber ruby? The json does not contain all the results - try with just a scenario see if that works as an experiment.

--K

On 6 Aug 2013, at 17:55, saikrishna321 [email protected] wrote:

I have a feature file which has 2 scenarios and both are parametrized with values after the test is completed the results dont appear .

—
Reply to this email directly or view it on GitHub.

[saikrishna321]

Yah i tried with just scenario and i get to see the results as expected . But when i have a Scenario Outline the scripts run but i dont see the results with the parameters that is used

For Example 👍

Scenario Outline:Tap on the sign in button and Enter Valid Credentials
Given I See Splash Screen
When I See Home screen and Tap on the Menu button
Then I Tap on the Sign in button
And I Enter the invalid username as
And I Enter the invalid password as
Then I Tap on the sign in button for logging in

Examples:
|username|password|
|[email protected]|qwerty|

[kingsleyh]

Yeah it's a bug with cucumber how it generates the json report. The json report is missing some results when using scenario outline so the plugin can only report that no result was found for the step

Sent from my iPad

On 7 Aug 2013, at 05:22, saikrishna321 [email protected] wrote:

Yah i tried with just scenario and i get to see the results as expected . But when i have a Scenario Outline the scripts run but i dont see the results with the parameters that is used

For Example

Scenario Outline:Tap on the sign in button and Enter Valid Credentials
Given I See Splash Screen
When I See Home screen and Tap on the Menu button
Then I Tap on the Sign in button
And I Enter the invalid username as
And I Enter the invalid password as
Then I Tap on the sign in button for logging in

Examples:
|username|password|
|[email protected]|qwerty|

—
Reply to this email directly or view it on GitHub.

[saikrishna321]

The json report looks like this , is there any workground to get this work .

{
"keyword": "Scenario Outline",
"name": "Tap on the sign in button and Enter Valid Credentials",
"line": 13,
"description": "",
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials",
"type": "scenario_outline",
"steps": [
{
"keyword": "Given ",
"name": "I See Splash Screen",
"line": 14,
"match": {
"location": "features/step_definitions/my_first_steps.rb:1"
}
},
{
"keyword": "When ",
"name": "I See Home screen and Tap on the Menu button",
"line": 15,
"match": {
"location": "features/step_definitions/my_first_steps.rb:9"
}
},
{
"keyword": "Then ",
"name": "I Tap on the Sign in button",
"line": 16,
"match": {
"location": "features/step_definitions/my_first_steps.rb:15"
}
},
{
"keyword": "And ",
"name": "I Enter the invalid username as ",
"line": 17,
"match": {
"location": "features\my_first.feature:17"
}
},
{
"keyword": "And ",
"name": "I Enter the invalid password as ",
"line": 18,
"match": {
"location": "features\my_first.feature:18"
}
},
{
"keyword": "Then ",
"name": "I Tap on the sign in button for logging in",
"line": 19,
"match": {
"location": "features/step_definitions/my_first_steps.rb:33"
}
}
],
"examples": [
{
"keyword": "Examples",
"name": "",
"line": 22,
"description": "",
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;",
"rows": [
{
"cells": [
"username",
"password"
],
"line": 23,
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;;1"
},
{
"cells": [
"[email protected]",
"qwerty"
],
"line": 24,
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;;2"
}
]
}
]
}
]
}

[kingsleyh]

no work around that I know of unfortunately. Hopefully the cucumber guys will fix it as it's been a bug for quite a while. The problem with this json is that every step should have a result section also - and the result section is missing. If you compare it to the json for a regular scenario - you will see the regular scenario json has a result section for each step.

Without a result section there is no way to know if the step passed, failed, was skipped or pending etc.

If I get some time - I will try to investigate with the cucumber guys and see if there is anything I can help with.
--K

On 7 Aug 2013, at 06:29, saikrishna321 [email protected] wrote:

The json report looks like this , is there any workground to get this work .

{
"keyword": "Scenario Outline",
"name": "Tap on the sign in button and Enter Valid Credentials",
"line": 13,
"description": "",
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials",
"type": "scenario_outline",
"steps": [
{
"keyword": "Given ",
"name": "I See Splash Screen",
"line": 14,
"match": {
"location": "features/step_definitions/my_first_steps.rb:1"
}
},
{
"keyword": "When ",
"name": "I See Home screen and Tap on the Menu button",
"line": 15,
"match": {
"location": "features/step_definitions/my_first_steps.rb:9"
}
},
{
"keyword": "Then ",
"name": "I Tap on the Sign in button",
"line": 16,
"match": {
"location": "features/step_definitions/my_first_steps.rb:15"
}
},
{
"keyword": "And ",
"name": "I Enter the invalid username as ",
"line": 17,
"match": {
"location": "features\my_first.feature:17"
}
},
{
"keyword": "And ",
"name": "I Enter the invalid password as ",
"line": 18,
"match": {
"location": "features\my_first.feature:18"
}
},
{
"keyword": "Then ",
"name": "I Tap on the sign in button for logging in",
"line": 19,
"match": {
"location": "features/step_definitions/my_first_steps.rb:33"
}
}
],
"examples": [
{
"keyword": "Examples",
"name": "",
"line": 22,
"description": "",
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;",
"rows": [
{
"cells": [
"username",
"password"
],
"line": 23,
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;;1"
},
{
"cells": [
"[email protected]",
"qwerty"
],
"line": 24,
"id": "login;tap-on-the-sign-in-button-and-enter-valid-credentials;;2"
}
]
}
]
}
]
}

—
Reply to this email directly or view it on GitHub.

[saikrishna321]

Thanks you so much kingsleyh . Appreciate the work . Closing the issue

[abusque]

This is indeed a cucumber issue. I've had the same problem with cucumber-jvm 1.1.3, but updating to 1.1.4-SNAPSHOT fixed it, you may want to look into this.

[saikrishna321]

I'm using this plugin to generate reports against calabash scripts . Can you please tell me where should i update the cucuber-jvm to 1.1.4

[saikrishna321]

is there any fix for this @kingsleyh

[saikrishna321]

https://github.com/masterthought/cucumber-reporting/blob/master/src/test/resources/net/masterthought/cucumber/project2.json

From the above report i see the Scenario Outline has proper results with status in it..

Can you please tell me if any specific version of cucumber has fixed this issue

[kingsleyh]

Hi

The problem is with the json report generated by ruby cucumber. As far as I know the cucumber guys have not fixed it yet.

--k

Sent from my iPad

On 25 Apr 2014, at 06:11, saikrishna321 [email protected] wrote:

https://github.com/masterthought/cucumber-reporting/blob/master/src/test/resources/net/masterthought/cucumber/project2.json

From the above report i see the Scenario Outline has proper results with status in it..

Can you please tell me if any specific version of cucumber has fixed this issue

—
Reply to this email directly or view it on GitHub.