On my boobs gonna hurt

Slowly wean off the breast, one feeding at a time. If you're not in a rush that is.

I would put cabbage leaves in your bra to dry up your milk supply.