Go to dollar tree! They have themed stuff, and it's all super cute! I did Butterflies for my daughter & got lots of compliments. Spent maybe $20 on decorations alone.

Does he like bubbles? You can do a bubble party :) You could also incorporate water balloons if your baby likes water.