my nipples are getting sore from breast feeding . but now it's been 2 months and my milk supply has gone down but when I pump don't come out as much only when he latches on

how can I increase my supply ? be fore my boobs would leak and I would freeze alot of it ?