I'm not sure sometimes he'll latch but other times he cries because he's laying down to eat instead of up. He's attached to the bottle to I got nipple shields but now he doesn't want to lay down and eat I'm literally about to break and I'm now where near done pumping :/

Have you had her checked for lip or tongue tie? It shouldn't hurt to breastfeed.

Or does she have a shallow latch?