Your best bet would be to speak with your local planning officer and find out what the chances are of obtaining planning permission. As RedOnion mentions the issue of "local needs" ( section 47,) you could establish if this applies to your area. Hopefully this would not apply but even if it does it may not be a problem for the other guy who is interested in buying your plot as he already has family ties with the locality and seems keen to move back.