I'm the same and also include play dates into that too! Even more laughable that I'm a teacher - I look after other people's kids (20-30 of them at once!) all day! But give me one extra child in my own home and I'm just waiting for it to be over.
I'm worse when DD is having a sleepover at someone else's house though, so I try to have them here as it's the lesser of two stresses.