The required textbook for the course is Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto, 1998. But you can get the draft of the 2nd edition here, and it is perfectly usable for this course.

Lectures on Reinforcement Learning by David Silver (UCL, DeepMind) is available here.

Notes made by Brent Wagenseller are available here.

Lunar Lander at the OpenAI Gym was a project Fall 2016.