Would it be bad if I took my 2 month old swimming with me?

no

nope!! I had my son in swim classes at 6 weeks old, he's now 10 months old and loves being in the water! its his favorite.