Don't worry, that stresses you and the baby out. Go to your doctor to get checked.... I heard that sometimes that can happen; the baby has its days where he/she is just not as active..