Call your doctor . They can prescribe an ointment to use after each poop ! And OMG it helps so much. I also went to Wal-Mart and bought hemorrhoid wipes and those are also amazing! With my first son I got them really bad and still have them and he will be 3 this year. Kinda TMI but when my butt hurts from them the ointment helps relieve it so much. When you push them back in make sure it's during shower time as it's easier for them to go in. Try not to strain or push if you can't poop it only makes them worse. But the ointment and wipes are a life saver. If they're really bad and nothing is working your doctor could recommend you seeing someone for them but the cream and wipes will definitely help.
@courtney.2019 I would buy the wipes and use them first than put on the cream. If it burns than it's really bad and you're wiping too much and it's sore. Mine gets that way sometimes. I normally use the wipes or baby wipes and than air dry my butt and then put the cream on.