I don't want to be a b, but my ex really does nothing for our son. When he's here to see him, which…

I don't want to be a b, but my ex really does nothing for our son. When he's here to see him, which isn't often, he'd rather watch tv or play on his phone. He's come by maybe twice in the last month. He came over last night and my son started to scream every time he held him, my son literally only cries if he's overly over tired or hungry. Every time I took him back, he stopped crying pretty quickly. Does it make me a bad person to feel somewhat happy about it? It makes me happy, because my son realizes that I will always be there. I do everything for him, I even told his dad how to calm him down and he didn't listen, whereas his dad pretty much just writes a check....