p-Groups with few Conjugacy Classes of Normalizers