Terror threat hasn't added much extra stress, poll finds