it is great that you both decided to pay off the mortgage. The break fee is very minor over the life of the mortgage, so go ahead and do it now.
Also good that you are maxing out the AVC, did you and your partner marry, it is so much easier to leave everything to your spouse if one of you died unexpectedly. Did you and he make wills? You are both accumulating wealth and it is good to have your affairs all in order.
You spoke about not working in the corporate world long term. Is you plan to build savings and investments to retire early or start a new business yourself?