So our church is a very "dressy" church, but it's already starting to get cold and I'm struggling…

So our church is a very "dressy" church, but it's already starting to get cold and I'm struggling with what to put my baby girl in to keep her warm but be dressed for church?? I feel like she is too little to wear leggings with her dresses but that tights won't be enough warmth? But at the same time, she is a baby (2 months) and it shouldn't matter what she is in? Opinions/suggestions???