Please don't ever think you don't contribute hon. I bet there are plenty of times you are left standing over the sink washing dishes while he relaxes on the couch in the evening. And who cooks for him and cleans his clothes and vacuums the house? The fact of the matter is that as women, if we didn't remember the birthdays and buy gifts, go grocery shopping each day, or leave little Post-Its around the house, then nothing would get done. Even if you don't work much out of the house, I'd still lay London to a brick that your are contributing inside the house - a lot.
I'm sure your DH is not an evil minion, but I still support your right to speak to him about this. It is important to you to have a baby, and if it's important to you then it should be important to HIM. The fact that he is working outside the house and you perhaps work more inside is of little consequence. And being that he is happy to drop $50K in legal fees to keep seeing his son just reiterates to me that he should understand the concept of how important it is for you to try for a baby also.