dualmindblade [he/him]

  • 10 Posts
  • 146 Comments
Joined 4 years ago
cake
Cake day: September 21st, 2020

help-circle










  • I know it’s hard but I believe we ought to reserve most of our hatred for the social structures which are literally optimized for the propagation and amplification of common human evil, and which transform non evil behaviors such as seeking food and shelter and protecting your family into new and alien evils that have not existed for most of our species history. Yeah people are shitty too, but this isn’t something we can change, and under a different society most of them would be a lot less shitty.

    I realize there’s a difference between believing you should feel a certain way and actual feeling, and it can be hard or impossible to bridge that gap, but bringing a belief that doesn’t match your actions and feelings to your attention creates a dissonance that your mind will try to resolve, it is possible to change the way you feel.












  • It really is, another thing I find remarkable is that all the magic vectors (features) were produced automatically without looking at the actual output of the model, only activations in a middle layer of the network, and using a loss function that is purely geometric in nature, it has no idea the meaning of the various features it is discovering.

    And the fact that this works seems to confirm, or at least almost confirm, a non trivial fact about how transformers do what they do. I always like to point out that we know more about the workings of the human brain than we do about the neural networks we have ourselves created. Probably still true, but this makes me optimistic we’ll at least cross that very low bar in the near future.