I want to go back to work. For not just my son but for me. But he's almost 3 months and it hit me…

I want to go back to work. For not just my son but for me. But he's almost 3 months and it hit me the time I'll miss with him. If I went to work for part of the day will he remember his mother? Will he still smile at me with his big, sweet, loving smile? Will he keep to his routine like mommy does with him? Will he not behave for daddy or grandma? Can I really leave him? Am I going crazy?