It’s part of the reason why having a few involved and keeping things in check is important. Sometimes the chief, as in your building, finds it easier to do most things themself esp when other committee members are not trusted/capable or apply themself, but when they make mistakes these can get through. I suggest getting to know your state’s legislation and bylaws so you can raise your concerns and back this up by quoting legislation which folks will want to know their committee and members are adherring to, and that alone can help right the ship.
I’m not convinced that needing to be on the executive is always necessary, esp if you don’t think you are up for the effort to get things corrected over the year you will be volunteering for. If you are: great, but you are on your committee already, but if you choose not to and can’t get them to act friendly in this regard act in your own best interest, even better if you can get others concerned as you are to help carry the load.