Where is the environmental state stored in RL-Glue?
In other systems, such as CLSquare, the old state is passed to the environment step function. The environment in RL-Glue is responsible for keeping track of the current state and computing the next state given an action. The old state does not need to be passed outside of the environment, the state stays within the environment. The next_state method in CLSquare is basically the same as env_step in RL-Glue.
