Fix the timer field for the solver

[kykim0]

The way the default timer is defined now could lead to the "world age issue" as it evaluates differently each time

[kykim0]

Also possibly the action_distrib_fn parameter. This seems replaceable with the simple actions(mdp, s).