The Doctor stepped into the fairy circle right at the start of the episode. This was a huge disrespect to the fairies, and it led to him disappearing and Ruby was left alone all episode.