I’m not sure of the issue
That you have done modifications that benefit your lot, would not be a reason to delay a sale.
The situation is that the sale document would show only your lot and the bylaws would show any agreed modifications.
A buyer would look at this and say that there is a risk for them in that they may be required to take down some modifications, or else put in time , effort and maybe money to have the modifications made legal.
It means you will get a discounted sale price (I’m not sure how you quantify that) as the buyer is taking a risk
However in a hot property market, many buyers will overlook such a defect if they consider it a good property