Everything in moderation. Even watching TV it would seem. Researchers have shown that watching more than 20 hours of tv weekly may lead to poorer sperm counts and quality.
Back to the gym boys!! The same study also showed that those who excercise of play more than 15 hours of sport weekly have significantly higher counts.
So if you want a baby, dont be a couch potato, go do something. As your wife always tells you!!