The label dialog is a bit annoying to use as you can't easily remove a label which isn't at the end. There has to be a notion of "selection" so that frozen labels can be selected and then removed rather than just the last one by pressing backspace.