[Bug] Devicebasiccomposition script needs to be updated in UI about certification-tool

[ccruzagralopes]

TH performs commissioning during the test suite setup before executing the test cases. These parameters should be set in the project config, under the "test_parameters" section. For example:

"test_parameters": {
   "int-arg": "use_pase_only:0",
   "qr-code": "<value>",
   "manual-code": "<value>"
}

As of right now these parameters are expected to have a underscore instead of a hyphen (int-arg, qr-code, manual-code), but soon that is going to be updated and the test_parameters will be expected to be set just like you use in the command line for the python tests.
So, for now, use it like this:

"test_parameters": {
   "int_arg": "use_pase_only:0",
   "qr_code": "<value>",
   "manual_code": "<value>"
}

However, the test cases from the TC_DeviceBasicComposition.py have a known issue that we're working on solving. These test cases don't expect the DUT to be commissioned when executed and TH is performing the commissioning before executing the test cases, which is causing the failure.
Regarding TC_DeviceConformance.py, I've tried running it the arguments you mentioned but it's failing for some reason, we'll have to investigate.
UI_Test_Run_2023_12_15_14_27_15.log

[cecille]

possibly silly question, but Device composition and conformance both use the data model XMLs from the SDK. Are those available in the TH?

[ccruzagralopes]

possibly silly question, but Device composition and conformance both use the data model XMLs from the SDK. Are those available in the TH?

That's a great point, actually. I believe they're not, I'll check it out.

[ccruzagralopes]

The data model XML files issue has been solved in the following PR:

• project-chip/certification-tool-backend#51

[ccruzagralopes]

This 2 python script has the below mention test cases, So instead of using these script directly adding the testcases in the UI can be better.

The following PR has updated the parser to show each individual test from a test script in the TH UI and allow them to be run separately:

• project-chip/certification-tool-backend#45

[Saravana-kr22]

@ccruzagralopes Adding the below parameters to the test_parameters make the commission to fail

"test_parameters": {
      "int-arg": "use_pase_only: 0",
      "manual_code": "34970112332"
    }

Reference log: TC-SM-1-1.log

[ccruzagralopes]

Hey @Saravana-kr22, there shouldn't be a space between use_pase_only: and the value (0). Please try using:

"test_parameters": {
      "int-arg": "use_pase_only:0",
      "manual_code": "34970112332"
    }