And likewise, seeing an "enemy" as handsome or pretty is a betrayal, as if he's giving them something they don't deserve.

The one exception seems to be Cedric, who goes from simply 'handsome' to 'useless pretty boy' when he starts going out with Cho. Apparently Cedric is so good-looking even Harry can't find a way to think of him as ugly *g*.