I had the through out my whole pregnancy. and I would try to take some Tylenol. I was told by my doctors that if I take Tylenol and it doesn't help my headache that I need to call them. and I would be careful with how long you have a headache. I had pre-eclampsia and it can cause headaches.
I get them all the time! Tylenol is safe just don't overdo it, and put an ice pack right at the base of your skull. That helps! I hope you feel better!!