180 Australians backing Islamic State, foreign minister says