Hi!

You better use policy gradient for your situation use my implement with cartpole and change the environment with lunar lander it will work. (You can also add a mini batch function).

https://github.com/simoninithomas/Deep_reinforcement_learning_Course/tree/master/Policy%20Gradients/Cartpole