Some quetions about app experiment about ares

[H2SO4T]

Hello, thank you for trying ARES.
I will investigate the problem in the next few days.

I'll keep you updated.

[H2SO4T]

To answer the questions:

1. The results are obtained during the training phase; we have never used the pre-trained model during the study. The purpose of reloading a policy is to boost the exploration of an app already tested.

2. The results are obtained using one hour of testing and setting 4000 steps as the maximum limit of steps. ARES will stop the app testing if it reaches the one-hour testing limit.

[Tangsuuu]

To answer the questions:

1. The results are obtained during the training phase; we have never used the pre-trained model during the study. The purpose of reloading a policy is to boost the exploration of an app already tested.
2. The results are obtained using one hour of testing and setting 4000 steps as the maximum limit of steps. ARES will stop the app testing if it reaches the one-hour testing limit.

I also try to test markor using random policy in ARES. Is it the same project(https://github.com/gsantner/markor) in your paper?
And I just find one-hour testing limit code(while not t.timer_expired():) in RandomExploration.py file. Steps limit sames don't work.
I also don't find collect_coverage_jacoco code in RandomExploration.py file and I add the collect_coverage_jacoco code to generate coverage files by myself.
I finally get 50.7% average coverage using 6000steps in 10 runs and 47.8% average coverage using 4000steps in 10 runs.
50.7% average coverage is close to the result(markor) in paper. So I guess random policy ran about 6000 steps in an hour.

[H2SO4T]

I also try to test markor using random policy in ARES. Is it the same project(https://github.com/gsantner/markor) in your paper?

Yes, but I have tested the 2019th version (I don't remember which one)

And I just find one-hour testing limit code(while not t.timer_expired():) in RandomExploration.py file. Steps limit sames don't work. I also don't find collect_coverage_jacoco code in RandomExploration.py file and I add the collect_coverage_jacoco code to generate coverage files by myself. I finally get 50.7% average coverage using 6000steps in 10 runs and 47.8% average coverage using 4000steps in 10 runs. 50.7% average coverage is close to the result(markor) in paper. So I guess random policy ran about 6000 steps in an hour.

I will fix the issues. Thank you for notifying me ☺️