Yes, that dihydrogen oxide can be very dangerous. http://www.snopes.com/medical/toxins/plasticbottles.asp
I must admit that it took me a moment.
However as a weekend cyclist I can confirm that the water in my plastic bottle tastes foul if left for a week. I don't think the same taste would come from a glass bottle.