Violence hits Sri Lanka port town