Yes that is okay. My daughter is almost four months now, and has been sleeping through the night since she was two months, and even the first two months of her life she would only wake maybe twice a night. Her pediatrician said not to wake them if they are sleeping through the night to feed them, and to wake her up during the day if there is a 2-3 hour gap between feedings and she is sleeping. It will help establish and maintain a great sleep schedule.