A little, yea. I have a two yr old so of course there is toys everywhere but with my 2 month old I only have a small portable swing and a rock-n-play along with the essentials. It's not to overwhelming.
it doesn't get better with the second lol I have toddler toys and baby stuff strewn around my house daily.... but you are correct, the baby stuff does take over, and it does so each time