PeterC is right. The balcony has been approved and there is a by-law that reflects that. These people need to back off and stop hassling you. You have no concerns other than their false claims. In that respect if it continues you may have to tell them that you reserve your rights in relation to actions that may devalue your property.