so finally after a couple weeks of wanting to talk to my so about my issues of finding his "love…

so finally after a couple weeks of wanting to talk to my so about my issues of finding his "love rags" (as I call them) every single day, I've finally talked to him. I told him how I am self conscious to begin with after having 2 kids and my self esteem is very low and always has been and he knows this. I've had sex with him but yet I don't feel like I please him cause I've constantly found his rags.. well after a very long talk he told me that I shouldn't feel any less because he does it cause sometimes he just wants to get the job done or because it's hard to find the time to have sex. I've still continued to find the rags and I'm mad cause we've had sex several times since this talk and he still feels the urge to masturbate. sorry for all the tmi but am I in the wrong for being upset still?