Where the win rate is recorded in the result log for SMAC experiment? about ace

[yifan123]

Thank you for your interest in our work. The win rate can be seen in seed0/log/evaluator/evaluator_logger.txt. Additionally, you can use Tensorboard to view the events file located in seed0/serial/ directory. Let us know if you have any further questions.

[ByunghyunYoo]

In this figure, does "final reward" mean the result (win or lose) of test episode?
Do I have to compute the win rate among these 32 test episodes if I want get the win rate ?

[yifan123]

In this figure, "reward_mean" means the result (win or lose) of 32 test episodes.

[ByunghyunYoo]

Thank you for your answer.

[ByunghyunYoo]

For checking performance in 32 test episodes, I'd like to draw the graph of "reward_mean" over total envstep_count as your paper. But, in "seed0/log/evaluator/evaluator_logger.txt", there is only "train_iter". I think this is different from "total envstep". Where can I find "total envstep" for drawing "total envstep vs. win rate"?

[yifan123]

You can use Tensorboard to view the events file located in seed0/serial/ directory or use scripts just like this to convert a tb file to a csv file.

[ByunghyunYoo]

Thank you for your answer.