I know that I will have to have him at some point but I really am ready to be done

No you won't! Don't worry. I felt the same way and my baby girl is a month old already. ❤️