Brown faces leadership concerns