Why would we be wiped out if they were properly instructed to be symbiotic to our species? This implies absolutele failure at mechanistic interpretability and alignment at every stage. I don’t think we’ll succeed in creating the existential viable intelligence without crossing that hurdle.
Most current problems already happen without a.i. and the machines will get better, we will not. From spam to vehicles, a.i. will be the solution, not the problem. I do think we should prioritize on dealing with the current issues, but I don’t think they are unscalable by any means.
Why? And why do you think intelligence of that level still couldn’t handle the concept of context? Either it’s capable of analogical thinking, or it isn’t an existential threat to begin with. RLHF doesn’t get us super intelligence.
Again this assumes we’ve completely failed development, in which case environmental collapse will kill us anyway.
Hey a real problem. Consolidation of power is already an issue without A.I.
It is extremely important we figure out how to control our own political and corporate leaders. A.I. is just another tool for them to fuck us, but A.I. isn’t the actual problem here.
Right now AIs are black boxes, there is no way to ensure they won’t behave in a non-symbiotic way.
Vehicles maybe, spam not so much. Current AIs can already fool AI detection systems to the point that they are flagging human generated content as AI.
A highly intelligent AI could decide to ensure its own self-preservation to be more important than caring about what happens to humans. Whatever goals it would decide to seek afterwards, could just as well trample over humanity without a second thought.
Environmental collapse won’t kill us, we already have enough tools for a minimal viable population to survive. A malicious AI could sabotage them, though.
AI is the problem in that those leaders are starting to blindly use it to make decisions, meaning those decisions are no longer the leaders’, but the AI’s.
Why would we be wiped out if they were properly instructed to be symbiotic to our species? This implies absolutele failure at mechanistic interpretability and alignment at every stage. I don’t think we’ll succeed in creating the existential viable intelligence without crossing that hurdle.
Most current problems already happen without a.i. and the machines will get better, we will not. From spam to vehicles, a.i. will be the solution, not the problem. I do think we should prioritize on dealing with the current issues, but I don’t think they are unscalable by any means.
Why? And why do you think intelligence of that level still couldn’t handle the concept of context? Either it’s capable of analogical thinking, or it isn’t an existential threat to begin with. RLHF doesn’t get us super intelligence.
Again this assumes we’ve completely failed development, in which case environmental collapse will kill us anyway.
Hey a real problem. Consolidation of power is already an issue without A.I. It is extremely important we figure out how to control our own political and corporate leaders. A.I. is just another tool for them to fuck us, but A.I. isn’t the actual problem here.