I would think that if you approach the chairperson before the meeting starts and tell them you wish to withdraw the absentee vote before any business is done, that would be fine. Absentee votes don’t count towards the quorum (proxy votes do) so the chair may be glad to have a real person in the room if the quorum numbers are tight.
Withdrawing the vote might be tricky later in the proceedings, once matters have been discussed and voted on, so get in early.