Glossary term
Glossary term
Architecture
One "unrolled" cell within a recurrent neural network. For example, the following figure shows three timesteps (labeled with the subscripts t-1, t, and t+1):
Created for this library
A logistics RL team uses one timestep per delivery decision so the agent learns dispatching at a meaningful granularity.
A trading research team uses one-minute timesteps in its RL execution agent so decisions match the available data resolution.
An energy company uses 15-minute timesteps in its HVAC RL agent so each step matches the building control system's cadence.
Definition source: Google for Developers Machine Learning Glossary | Creative Commons Attribution 4.0 License