May be a final comment from me.
You can’t in normal circumstances be “unvoted” from a committee
The act says the maximum number of committee members is 9. In a block of 5 if all lots nominate one person every nominee will be on the committee, unless a motion is passed to limit the numbers of committee members. But then a vote needs to be taken to elect members from the nominations.
I agree that Jimmy’s last advice is pretty correct.