They tend to keep the contents more fresh than plastic bottles and are easier to clean. If you do happen to leave some milk or drink in them too long, the rotten smell doesn't stick like it would to plastic.
They are more expensive though. Only real downside in my opinion.
Just be careful not to drop them. But that's the case with anything glass.😂