Depends on why. My mom hugged a lady one night at church and she didn't hug her back she was just real stiff and wouldn't even smile. At first I thought it was so rude but she had just experienced a death in the family so I understood her reluctance to return the hug

Id feel some way like hug me bck tf lol but thats just me