he is her father and wants to be in her life. i justc would rather him not be in there since he quit being in my life i think its my time.

Yes

He can if you ask him to. Otherwise, you can deny him that but if you seek any support from him they will have you establish paternity with a DNA test.