Why does he say "if I hurt you"? Don't he know if he hurt you or not? lol but anyway, maybe take it slow, and be sure you are clear about your needs and what you expect and how you want things to be different....but I don't see why not!
I always say do what you think it's best. no one can tell you otherwise! If there was no violence involved I think people deserve a second chance. When there's love there's still hope. and you both obviously love each other.