Help with gym continuous mountain car environment

[ashBabu]

Hi,
I am quite new to RL. I found the example of gym_pendulum.py very useful and I was trying to do the same with continuous mountain car. My code is available here. It does not converge. I am not sure which hyper parameter to tune or what the value of downward_start start to use.

Any help would be really appreciated. Thanks