Am I wrong for not wanting people to play favorites with my kids??

I mean yeah my youngest is still in newborns at 4 months but my almost 2 1/2year old still can't fit in 24month clothes.. Why should the size of a child make you favor them more?? I don't like the favorite game. I was raised in a family that chose favorites and it tore my family apart and I just don't want that happening to my kids..

I feel like I'm wrong but right at the same time..
Sorry I just needed to vent and see what other mommies thought about the favorite game