Definitely have it at your house!
its your party!
I had mine at my house and it was great! You get tons of presents (even if you ask for none) so you don't have to transport them all and people really want to see the nursery.
Driving isn't an issue.. they will get over it!
do what you want to do!!!!!