Residents flee Pakistani valley as PM vows peace