Unlatch and try again, but gently remind him no. My daughter does this too when she teething! Sometimes I just give her my finger or chew toy to get her soothed

You don't need to give a bottle. Just take him off, say NO and try again. And watching for when he's done eating or he'll start to play with it instead if eat. Im going through it right now. They just gotta learn.

@kambam, he will not take a bottle though. So we just end up both being frustrated because feedings just end up taking so much longer.

Remove him every time he does it