Early design thoughts on rune swapping are that there would be some sort of cost to remove them so a new one could be put in its place. Early in the character’s life it would be inexpensive enough so it isn’t prohibitive, as we want to encourage experimentation, but later on the cost would become more substantial.
In addition, the high end runes are intended to be very rare. So while you’re looking for them we want you to be able to use the runes you have without fear of losing them or using them incorrectly. Being able to experiment with different runes along the way to creating your perfect character is more fun, and potentially enlightening to the different ways your character can be used.