It's totally fine to do room temperature. I would try to continue doing it that way just because then when you're out you don't have to worry about warming up a bottle. I just pack a water bottle and go!

and I leave it in the fridge already made before bed so I have to heat it up anyway

no you don't have to heat it up, I only do it cause my son likes it that way :)