Handle the permission hierarchy better so the actual permissions result displays permissions correctly