You do not have to keep the baby up for an hour or 2. The only time you should be concerned is if they immediately fall asleep or won’t wake up after sleeping.
If you see any signs of distress, like he is hurting I would take take him in. Otherwise like you said mamma it happens, your not alone. Don’t feel bad.