Comments (1)
Hi!
During the implementation of ARES, did you ever think of trying to implement a way to evaluate an already trained model, and not just continue with the training? Since in your paper I don't see it mentioned as a limitation.
I have not evaluated a trained model, but you can try to do it. However, it would be best if you waited more than one-hour testing so that the learned policy can learn the correct action according to the observed state.
Besides, at this moment I am trying to implement it, but I have been stuck because of a limitation that may be Stable Baselines3 has to change the action space each time you try to predict an action.
In the function env.step()
there is an if statement
that checks whether the environment can apply the action generated by the NN to the current state of the application under test. Unfortunately, you can not modify the output dimension of the NN (the action space you are referring to). The only way to always output a "correct" action is to learn an optimal policy, which means training the RL algorithm for hours (or more, as the answer is not obvious and not guaranteed).
Let me know if I can help again!
from ares.
Related Issues (17)
- Some questions about running HOT 1
- Quick question about SACExploration.py HOT 4
- which version of appium should I install? HOT 5
- adb: error: failed to stat remote object '/mnt/sdcard/coverage.x': No such file or directory HOT 3
- Cannot start the 'com.android.insecurebankv2' application HOT 4
- Crash after the error "type numpy.ndarray doesn't define __round__ method"
- about the observation HOT 1
- Adb error - failed to access HOT 5
- Problem when running ARES HOT 2
- Reload a previously learned navigation policy HOT 2
- where can I get your app benchmark ? HOT 1
- how to use collect_coverage_emma and collect_coverage_jacoco
- Q Learning and random seem not work well HOT 8
- Some quetions about app experiment HOT 4
- Some questions about RL_application_env.py HOT 16
- ARES seems blocked HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ares.