Petrol bombs thrown during alert