It's probably sealed/bonded with caulk, silicone or some other sealant. There may be a solid connector within the wall to prevent drafts. Is the hose the plastic or metal type? You'll most likely need to cut it close to where it enters the wall, then rip the remainder out. If plastic, latch a vise grips onto the reinforcing wire and pull away. If metal, there is usually a spiral joint, again, latch on the vice grips and pull!