Need advice! I'm on antidepressants and it's only a 20 ml dosage once a day. My sons dad called me…

Need advice! I'm on antidepressants and it's only a 20 ml dosage once a day. My sons dad called me demanding I stop breastfeeding. My doctor told me it was ok that my baby is gonna be ok. He's completely alert and healthy and his doctor says he's very advanced for a boy his size. Any mommies ever have this dilema?