Ousted Nigerian ruling party governor loses appeal