I mean, weren’t they still wearing their robes during class in PoA and later films? Even in philosopher’s stone they wear sweaters and pants during christmas break.