You’re not wrong. That said sometimes it can be self-deprecating.

In any case, one substitute is “non-nerds”, but I’m sure someone can think of a term that fits even better in the meme.