Are you for real? Have you never been inebriated? Don't you have the foggiest of how pickpockets are adept at plucking phones and other items stealthily ?
No need to fight over it. No matter how drunk I was, if someone snatched it from my hands, I would notice. But if they took it stealthily from my back pocket, I might not notice, no matter how sober I was.