The doctors told me the only way you can dry up is if you don't have a really good latch and the baby's not getting enough but if you keep feeding constantly with a good latch you shouldn't dry out at least that's what the breast feeding videos said that I watched keep trying and talk to a breastfeeding coach or a pregnancy crisis center in your area about it @glucio
Yeah if it's hurting more than just a little throbbing after you nurse you could have clogged ducts like @kdubs2066 said. If you stand in the shower and let warm water run over them and try hand expressing some it will help. Do you have a pump? Definitely use it if you have one, that'll help get the milk going as well. And massage while you do so. You can also make "heating pads" out of rice in a bag and put it inside of a sock or wrapped in a towel. Stick them in your bra and it'll help the milk come down.
I don't think that's normal did you try rubbing it while she or he feed? I would add warmth to it as well it might be a clogged milk duct and talk to you doctor.
I know when I got thrush from my son my breasts throbbed more and it was excruciatingly painful. Is it hurting just after you nurse or all the time? Unfortunately it is normal for there to be a throbbing pain in the beginning. My son is 4 months on the 4th and it stopped being painful once he reached about 8-9 weeks old.