If you are strapped for cash could you increase your work hours? Or could your hubby get a part time job that is more flexible even if it isn't in his chosen career field (eg night fill at a Supermarket).
I couldn't cope if my hubby hardly ever saw the kids - he couldn't cope either. I don't want that life for any of us.
That being said if there is absolutely no other way your DH could always do things like FaceTime/Skype your bub at bedtime. And have half a day on the weekend where you go off and do your thing and hubby spends one on one time with your DS.