You might have to go to a doctor and have them drain it. My ears were closed for years and then one got a slight infection. I poked it through with a clean earring and used rubbing alcohol, I think. Mine had hurt a bit, though.

@lovelily, I’ve been using the cleaning solution you get when you first get pierced. It’s helped a little