Choosing Which Benefit Function to Maximize

So how are we going to strike a proper balance between time spent predicting the behavior of the environment being observed and the ability to react quickly to unexpected changes?

While in general that depends on the particular problem we are trying to solve, the process by which the actions to perform are chosen will be referred to as a *Strategy*.