Wizards would know what normal clothes are. I think that by them wearing the normal clothes it shows that they arentr so secluded from the woorld that they dont even do the same things as muggles. There are probably more half blood kids or kids like Hermione from muggle families than pure blood wizards. So because of this they would know what casual clothes are.