Might be an idea. Make note who was around when he said things, too, perhaps.
I've already started a sort of diary for the future baby. My mother wrote a diary for me while she was pregnant, and I actually really loved it. She gave it to me when I was 13. I've always wanted to do the same thing.
I'd keep the two completely separate but at least I'm already getting into that habit.