I wouldn't go because I couldn't be away from my kids for that long (regardless of birthday or not). I accidentally booked 2 nights for a weekend away to celebrate our anniversary (thinking it was a booking for 1 night) and I've already told them it will only be for 1.
Every child and family is different. Just do what your heart tells you, don't listen to anyone.
Oh even if dh was home, it would be madness. He would probably be crying on the phone (along with the kids) after the 2nd day for me to return, haha.