If you hang tough and then they still want to proceed then it is obvious there is or was no other buyer. Why not turn the tables on the EA and tell him you have found another house and you want to pull out - look for 10K off the price etc.?
Problem is they are not hanging tough asin delaying, they are simply following the right procedures. If they 'turn the tables' then they risk losing the house.