I wouldn't agree there at all with you, we came to a very amicable agreement a few years ago with our very approchable neighbour to remove a very large boundary fence between our properties and we both build a fine extension. Such was our good relationship neither side didn't involve any legal representation.
I think it is all about attitude, from what I can see you and your neighbour are after setting up a very bad relationship and this has cost you both dearly in terms of stress, legal fees and the loss of neighbourly friendliness. This could all have been handled very differently from the start.