I had glass bottles for my little one and we would heat a pan up with water on the stove and just swish the bottle around in the pan until it was nice and warm. :)
Have you guys used bottle warmers? I've seen people put the breast milk bags in the bottle warmer to warm it up/thaw it out but I feel it could be way too hot.