It could affect his sperm count, could he cut back a little while you're trying to conceive? Some people are just so fertile it doesn't matter but if you've been trying for a while and it hasn't happened I'd start making some changes.
Lots of water for both of you, no smoking, track your periods and when you're ovulating.
^^ I agree.