My 2 year old doesn't like me to touch him most times and will throw a fit like when I have to…

My 2 year old doesn't like me to touch him most times and will throw a fit like when I have to change his diaper because I have no choice but to touch him or when he gets upset I can't console him cause he won't let me touch him but sometimes will want to be picked up and cuddled. I don't ignore him I give him all the attention even while dealing with my newbie and include him when it comes to doing things with his brother which he loves but still doesn't like me touching him. Anybody ever deal with this, how long does it last?