Firstly, I think it's really easy to never have your child watching tv when you only have one child. For people with two or more it gets harder to have a moral objection to the tv.
Secondly, it's a personal decision based on the temperament of your child. My eldest son who is gifted was intently interested in the tv from about four months and would laugh at the same jokes on baby Einstein videos so I could tell he was engaging with the program and not just watching a blur of colours as some researchers have suggested. My second couldn't have been less interested in tv and was much happier to play. Is still that way. My youngest isn't into tv and has only just at 18 months started to watch the wiggles, but he's very fussy and will only watch certain programs. It most certainly is possible for kids to have favourite programs.
Thirdly, I don't care what the research says about the negative impacts of tv. For me the are far outweighed by the little bit of sanity that is gained by half and hour of peace. If your child isn't as demanding as those of others then I can see why this may not seem reasonable.
Finally, people who choose to refrain from exposing their children to tv are not better than mums who choose to let them. It's a personal choice, no right or wrong and there should be no judgement.