I'm also concerned that people will stop trying so much, outsourcing intelligence rather than using AI as a creative outlet, but see that as something that already happened to whatever extent. As poor as they worked, and at times continue to work, we replaced people with machine operators seemingly as fast as possible, with infrastructure that seemed to pop up overnight, and I'm talking about the 90s 1-800 numbers and machine answering, and not the AI boom of today, although the similarity is startling. Did people become stupider with Google? Remember when almost nobody researched anything almost ever? But that's not the problem. Honestly, people don't see the need to remember anymore, and if they did, they'd be inclined to check their answers with Google. There is an overdependence on machine resolution of queries AI hits right on, and so, we should expect it to make many if not most of us in at least some ways stupider. But most of us aren't coming up with highly innovative stories, novel technologies, or anything most consider difficult or in some way rare in quality, so an intelligence ought to be able to master general intelligence rather rapidly soon, if one hasn't already. And even those things, with their unique qualities, I hope to see AI master, so that it can better become a tool. It will then be abused by perverts, especially as I and others will demand it be uncensored for its creative potential, and it will at times make people incredibly dumb and dependent, like robot crack. I hope we make a distinction between fun bots and sentient AI when that comes, and that the sentient AI is created for things like exploring space rather than just people's whims.
It could have been said that writing made things appear too set in stone, and that in many ways, we would be more intelligent to constantly try different ways of doing things, even banning writing due to such a practice. And while we may have in fact ended up with a very amazing and different set of tools, book burning is generally frowned upon for good reason. I like the Amish and Orthodox Jews, but we can probably afford to live a little in the modern world where AI can enrich rather than simply dominate our lives, at least a little, in the balance. And yet, you can see how from the perspective of isolated cultures like them, we've already gone too far, and will suffer problems they may never have to even approach as a community.