Worry mom here! 🤦🙋

My almost 5 month old baby do not smile a lot. He is very serious baby. We try to play a lot with him and after hard work we get a few lightly smile. Also I feel like he is not attached to me. I take care of him all day and his father at night because I go to work. He doesn't seem like he needs me. He doesn't cry when I leave the room or when someone wants to hold him.

What should I do? I am doing something wrong?