I had the similar situation of a committee member being the reason managers resigned. The owners decided to deal with the issue by. Always voting at each AGM for the number of committee positions to be One less than the number of nominees. So if 7 people wanted on the committee then they voted for there to be a committee of 6 members. Unsurprisingly the painful owner never made it onto the committee. Its legal and I think fair, as it shows that the owners don’t want that person on the committee.
If you can’t get the owners to reign in the member because they can’t be bothered to. Then I am sorry to say welcome to the nightmare of owner apathy. It is the one single hindrance to the effective running of a property.