I do the same thing with making my bed. I have 2 cats and if one is curled up on the bed, I don't bother him. Not that he doesn't get plenty of sleep-lol.

I have one cat who doesn't often curl up on my lap, so when he does, I don't move either.