"It never did occur to me"

But I didnt want to let you down

Sooner or later that you would find out