Odd reaction to milk

We've been trying to transition to whole milk so I can wean soon, but it's not going well. At first he'd barely take a sip and then refuse; I tried different temperatures, but to no avail.