While talking with the abusive tenants might not be an option, talking to the few resident owners could be worthwhile. Perhaps the approach is to come right out and say you have heard that there are rumours and you wish to deal openly and frankly about them, that you invite owners to talk to you and others on the EC etc. People who might pass on gossip might be a lot more careful if you show you treat suggestions of impropriety very seriously.