It seems you have already reached the stage of asking the landlord to allow you to break your lease.
have a look at this factsheet which explains how to do it legally and without any comeback: https://www.tenants.org.au/factsheet-16-ending-tenancy-early