Is it just ME? Or is it harder to have a second baby than a first?!

With my first I wasn't even trying and I got pregnant. But now me and hubby want to have a second and nothing is happening. 😓