A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.
Every time this comes up, all the tech nerds here like to excuse it as fine and not a bad thing at all. I am hoping this won’t happen this time, but knowing lemmys audience…
It’s not a matter of excusing it. Distribution of someone’s picture without their explicit consent, and anything like that, is inexcusable. But we’re talking about the generation of said content, which technically can’t be stopped without seriously restraining everything.