Environment Step: float or int? about gold

[dtitov]

Hm, my bad. I've just re-read the action definition here: it's given as intervals, e.g. -1..0 off, which means that integers can also be used in this case. I still wonder though if there are other environments where the action actually has to be a real value... 🤔

[pbarker]

Hey @dtitov, yeah I believe actions are currently only discreet, and I had planned on supporting continuous in the future. If you're up for it, feel free to add, although I think some of this would be simpler once generics are available.

[dtitov]

I think some of this would be simpler once generics are available.

Very likely :) Let's wait for it then, thanks.

[dtitov]

Hm, I now stumbled across a different issue: arity of the action/step. In the current implementation, action is one number (doesn't matter whether it's int or float). But for the lunar lander, action is a vector of two numbers. How is that supposed to be handled? 🤔

[pbarker]

Ah yeah I had only tried out a couple environments with the agents so far and hadn't progressed to lunar lander yet, the action out of the agent probably needs to be a tensor. That would need a change, but I'm pretty swamped with the day job and a toddler right now 🙂

[dtitov]

Right, I see. Thanks anyway.