Sri Lanka monitors ‘will not go’