"I didn't," the Doctor answers. But how best to explain this...

"I'm not from here. The song's an older one, from where I used to be." He explains everything in a genuine tone. The Doctor isn't pulling Imogen's leg, he's not making fun of her or dodging the questions, he's giving her actual answers. They are vague as hell answers, but they're still answers.