Technology

You seem to not understand the scale at which these things operate. We're not talking about niche tools that only incels and creeps will use to jerk off to CP, we're talking about tools that can be used to manipulate, spread mis- and disinformation, and imitate actual people doing things they wouldn't normally do, and can do so at a scale that is exponentially greater than anything we've ever seen.

Go take a look at Facebook. Log out of YouTube and look at the front page. Try to do a Google search. Look at the absolute flood of AI generated shit. I know a lot of authors of short fiction, and the publications that they submit to that normally see a couple hundred to a couple thousands of submission per month have been flooded with hundreds of thousands of submissions per month, all AI garbage.

Now imagine it becomes so good that it's indistinguishable from the real. Pics, vids, articles. The scale and speed at which people can create society-level harm and destroy lives is incomprehensible. This is not a "think of the children" thing. This is an inflection point where you will never know if the video you just saw of a political candidate calling for the extermination of X group is real or not. But the harms and consequences will be real. You will see revenge porn not just of nudes, but of videos of people seemingly doing horrific acts, and having their lives ruined because of it. And it will happen so fast and in such a flood that nothing will be able to stop it or counter it, because no one will see the truth buried in the inundation.

Again, we could do some of this now, but not at the unimaginable scale or speed that AI generation allows for.

This is not a good thing. And if this is the world you want, then there is no reasoning with you. You are truly lost.