Tell HN: Nascent idea: "super intelligence" is not about superior intelligence
It's actually about the primacy of true intelligence. What if....
What if there is no "super intelligence"???
What if what we have already (our human intellect in its most perfect/refined form) is already the pinnacle?
What if you can't be "smarter" than that? Just faster/more focused/etc.
What if "super intelligence" is not about something smarter than us...but simply, about, finally the primacy of intelligence as some kind of moral sorter/divider?
The restoration/establishment of "raw intelligence" as a moral virtue or north star? The primacy of true intellect?
No more woolly thinking, no more fake hand-wavey ideas. What if "AI super intelligence" is really about fading out all the bs "intelligence" and surfacing/primarying true intellect?
Idk. Just an idea.
I wouldn't say that human intelligence is "the pinnacle" but I do think that more intelligence might not turn into the ability to solve harder problems.
For instance the problem with high energy physics is not that people don't have ideas but rather we have limited experimental and observational results that would let us tell one theory from another.
Similarly I don't think more intelligence would help in solving the Collatz conjecture.
This is a good distinction between "intelligence" and data. I think we talk the same stuffs! :)
Do we here all agree then that there's more than enough "moral data" out there?
Maybe too much?
Both extents are consistent with Sutskever's ideology that Lossy Compression [Reduction?] Is all U Need (probably superseding AIaUN)
Hey, i think there's no such thing as an upper limit and we can always go further or become better. We will never reach the maximum, we can only reach the limit that we won't cross.