The UK is the only country that doesn’t need to print its name on its stamps. They figured the Queen’s face was good enough branding!
Not all stamps are rectangles! Some countries issue triangle, circular, or even heart-shaped stamps. Why should letters have all the fun with geometry?